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PREFACE 


This  study  represents  the  combined  efforts  of  tirree  military  Research  Fellows  participat¬ 
ing  in  an  11-month  Senior  Service  College  Research  Fellowship  program  sponsored  by 
the  Under  Secretary  of  Defense  (Acquisition).*  The  fellowship  program  has  two  pur¬ 
poses:  first,  to  provide  professional  military  education  for  selected  officers  from  the  Aimy, 
Navy  and  Air  Force;  second,  to  conduct  research  in  a  subject  of  vital  interest  to  the  U.S.  defense 
acquisition  community.  In  keeping  with  its  role  as  the  center  for  systems  management  educa¬ 
tion  in  the  Department  of  Defense  (DOD),  the  Defense  Systems  Management  College  (DSMC), 
cooperating  with  the  Harvard  University  Graduate  School  of  Business,  provided  the  means  for 
conducting  this  study.  The  fellowship  program  indudes  the  12-week  resident  Program  for 
Management  Development  (PMD)  course  at  Harvard  University,  Cambridge,  Mass. 

During  December  1992,  we  evaluated  potential  topics  for  our  research  effort  As  we  began  to 
focus  our  efforts,  it  became  dear  that  current  and  future  reductions  in  defense  acquisition  ex¬ 
penditures  would  significantly  impact  how  we  buy  weapon  systems.  New  defense  and  acqui¬ 
sition  strategies  are  focusing  on  potentially  dangerous  regional  conflicts,  while  retaining  the 
capability  to  respond  to  emerging  threats.  Regional  powers  have  increasing  access  to  Western 
weaponry  and  high-quality  equipment  from  fire  former  Soviet  Lmon.  The  United  States  must 
maintain  its  technological  advantage  to  meet  this  threat 

The  Director  of  Defense  Research  and  Engineering  (DDR&E)  has  formulated  a  new  science 
and  technology  (S&T)  strategy  to  address  this  challenge.  The  core  of  this  strategy  is  to  provide 
for  eeirly,  intensive  and  continued  involvement  of  warfighters  in  weapon  design;  fuel  and  ex¬ 
ploit  the  information  technology  explosion;  and  conduct  extensive  and  realistic  technology 
demonstrations.  From  an  acquisition  viewpoint,  the  concept  cf  virtual  prototyping  offers  tre¬ 
mendous  potential.  Imagine  building  prototypes  with  computers,  testing  performance  in  a 
synthetic  battlefield,  conducting  trade-off  evaluations  of  existing  systems  vs.  modified  systems 
vs.  new  systems  —  all  before  bending  any  metal.  The  possibilities  and  challenges  are  enor¬ 
mous,  which  is  precisely  why  we  selected  the  topic. 

Readers  pressed  for  time  may  wish  to  proceed  directly  to  the  Executive  Summary  where  perti¬ 
nent  points  and  recommendations  are  sununanzed.  For  others.  Chapter  One  explains  the  ob¬ 
jective,  methodology,  assumptions  and  background  of  the  report  Chapter  Two  explains  the 
defense  environment  and  the  role  of  virtual  prototypes  in  the  new  S&T  program.  Those  famil¬ 
iar  with  the  S&T  initiatives  may  want  to  go  directly  to  Chapter  Three  where  the  entire  spec¬ 
trum  of  synthetic  environments  is  discussed.  Chapter  Four  examines  the  application  of 
synthetic  envirorrments  in  the  acquisition  process.  Chapter  Five  then  gives  a  detailed  accovmt 


•NOTE:  Since  this  writing,  the  Under  Secietaiy  of  Defense  (Acquis  ition)  (U5D<A))  has  changed  to  Under  Secretary  of 
Defense  (Acquisition  and  Technology)  (USD(A&T)). 
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of  synthetic  environments  applications.  The  summary  and  conclusions  are  contained  in 
Qiapter  Six,  the  final  chapter. 

We  could  not  have  undertaken  a  project  of  this  size  wiBrout  the  cooperation  and  contributions 
of  many  people.  During  the  writing  of  this  report,  we  have  been  thankful  for  their  help.  The 
faculty  and  staff  at  Harvard  University  and  the  DSMC  have  been  extremely  helpful  with  their 
insights  and  encouragement.  Others  include  Lieutenant  Colonel  Carl  Bryant,  USAF  (Ret.),  for¬ 
mer  Executive  Director  of  Research  at  DSMC,  who  served  as  our  mentor  and  provided  helpful 
advice  throughout  the  research  effort.  Special  thanks  to  the  DSMC  faculty,  especially  Dr.  Robert 
J.  Ainsley  and  Mr.  Randy  C.  Zittel,  for  their  valuable  insights  on  modeling  and  simulation.  This 
report  would  not  have  been  possible  without  the  gracious  assistance  we  received  from  the 
many  individuals  in  diverse  locations  involved  in  defense  and  commercial  business  who  dis¬ 
cussed  their  applicatiorrs  of  virtual  prototyping.  Many  took  time  from  demanding  workloads  to 
share  their  experiences  and  comment  on  the  future  of  modeling  and  simulation. 

Our  sincere  appreciation  to  Ms.  Joan  Sable,  fellowship  program  coordinator,  who  ensured  our 
administrative  and  logistical  requirements  were  met  at  DSMC  and  Harvard,  and  whose  sup¬ 
port  enabled  us  to  concentrate  our  attention  and  energies  on  the  research  and  writing  of  this  re¬ 
port  We  are  grateful  to  the  competent  and  courteous  DSMC  librarians  who  assisted  us  in 
obtaining  the  necessary  materials  to  complete  our  research. 

We  appreciate  the  efforts  of  the  DSMC  Press  staff  for  their  many  hours  working  on  this  report 
to  ensure  its  highest  quality.  Their  willingness  to  allow  the  use  of  color  photographs,  a  first  at 
DSMC,  is  especially  appreciated.  Thanks  to  the  Visual  Arts  staff  for  their  work  on  the  graphs, 
charts,  color  photographs  and  cover  page  as  well  as  their  many  hours  in  the  layout  of  this  re¬ 
port 

We  dedicate  this  effort  to  all  those  we  interviewed.  May  our  report  be  as  helpful  to  you  as  you 
were  to  us. 


EXECUTIVE  SUMMARY 


PURPOSE 

We  undertook  this  research  project  to  assess  the  feasibility  of  using  virtual  prototypes  in  the 
DOD  weapon  systems  acquisition  process.  Our  goal  was  to  identify  £md  assess  the  current  uses 
of  virtual  prototypes  by  commercial  companies,  defense  contractors  and  universities.  The  De¬ 
fense  Science  Board  and  die  Defense  Modeling  and  Simulation  Office  are  confident  that  virtual 
prototyping  can  have  a  beneficial  influence  on  the  defense  acquisition  process.  We  were  skepti¬ 
cal  about  the  usefulness  of  virtual  prototyping  and  were  curious  to  see  who,  if  anyone,  was  us¬ 
ing  virtual  prototypes  in  the  development  process.  We  wanted  first-hand  impressions  from 
people  with  hands-on  experience  on  how  they  viewed  the  utility  of  virtual  prototypes,  their 
successes,  disappointments,  key  risks  and  challenges.  Because  "virtual  prototype"  is  becoming 
a  buzzword  in  today's  vernacular,  we  wanted  to  know  what  people  from  industry,  government 
and  academia  meant  by  the  term  and  how  they  envisioned  its  application.  This  then  was  our 
charter  —  to  assess  and  describe  the  current  state  of  virtual  prototyping. 

METHODOLOGY 

We  approached  this  project  from  four  different  directions.  While  at  the  Harvard  University 
Graduate  School  of  Business,  we  discussed  our  topic  with  faculty  members  and  with  fellow 
students  from  U.S.  and  international  companies.  A  primary  reason  for  pursuing  the  topic  was 
the  emphasis  Harvard  University  placed  on  the  importance  of  gaining  a  competitive  advan¬ 
tage.  The  decline  of  the  our  nation's  manufacturing  base  reflects  the  difficulty  of  competing  in 
today's  international  markets,  so  our  topic  seemed  particularly  relevant  in  its  exploration  of 
techniques  to  enhance  competitive  advantage. 

Upon  returning  to  the  Defense  Systems  Management  College,  an  extensive  literature  review 
identified  more  than  500  articles  of  possible  relevance  including  books,  periodicals,  research  re¬ 
ports,  government  policy  letters,  instructions  and  regulations.  Ultimately,  we  relied  directly  on 
more  than  150  documents  for  this  report  Our  background  research  indicated  that  no  one,  to 
date,  had  addressed  the  broad  range  of  virtual  prototype  applications  nor  had  any  comprehen¬ 
sive  assessment  of  its  current  and  potential  benefits  to  die  defense  acquisition  process  been  ex¬ 
plored.  We  found  the  literature  on  current  applications  to  be  limited,  and  after  several  visits  to 
contractor  facilities  we  began  to  understand  why.  Each  company  considers  virtual  prototyping 
a  key  ingredient  of  their  ability  to  compete,  and  they  do  not  want  the  specifics  of  how  they  are 
using  this  technology  to  become  available  to  their  competition.  We  agreed  with  each  company, 
prior  to  our  on-site  visit,  not  to  publish  anjrthing  they  considered  to  be  sensitive  and  we  have 
honored  their  requests  in  this  report  This  agreement  notwithstanding,  one  of  the  most  benefi¬ 
cial  aspects  of  this  report  may  be  our  compilation  of  releasable  information  on  real-worid  ap¬ 
plications. 
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Comments  from  real-world  practitioners  were  especially  helpful,  and  tt>e  insight  they  provided 
could  not  have  been  collected  without  on-site  interviews.  By  visiting  several  of  the  leading  uni¬ 
versities  sponsoring  research  in  this  field,  we  were  able  to  observe  and  operate  some  of  the  fu¬ 
turistic  equipment  that  will  be  influencing  this  technolc^y  during  this  decade.  Our  report  is  a 
combination  of  what  is  being  used  today  as  well  as  a  look  at  what  might  be  used  tomorrow. 
The  candor  of  the  people  with  whom  we  spoke  is  greatly  appreciated.  Accordingly,  we  believr 
dris  study  is  important  because  it  provides  information  that  is  not  available  elsewhere.  It  is  p 
ticulaily  relevant  to  today's  defense  acquisition  policy  makers  as  well  as  those  responsible  i 
establishing  national  policy  and  programs  to  enhance  our  country's  infrastructure  and  out 
competitive  position  in  the  international  maricetplace. 

ASSUMPTIONS 

We  assume  the  current  defense  budget  reduction  trend  will  continue  for  the  foreseeable  future 
and  DOD  will  need  to  be  more  efficient  with  its  ever-decreasing  acquisition  budget.  Because 
we  assume  ffie  future  will  present  even  more  signihcant  acquisition  management  challenges  to 
DOD,  we  believe  it  is  important  to  examine  technology  ffiat  may  enable  the  defense  acquisition 
process  to  maximize  the  nation's  waifighting  return  for  its  limited  investment.  If  budgets  do 
not  dramatically  decrease  in  the  future,  we  believe  virtual  prototypes  can  still  play  a  significant 
role  because  they  have  become  a  key  element  in  maximizing  the  benefits  realized  from  concur¬ 
rent  engineering  programs. 

BACKGROUND  OF  THE  PROBLEM 

Fundamental  changes  are  underway  in  the  defense  acquisition  process.  The  Cold  War  has 
ended  and  the  Arms  Race  has  been  won.  No  longer  does  "The  Threat"  drive  the  acquisition 
process  and  with  its  demise  goes  the  funding  that  permitted  multiple  major  weapon  system 
new  starts.  The  DOD  is  dramatically  refocusing  its  acquisition  philosophy  to  ensure  only 
weapon  systems  which  significandy  influence  the  outcome  of  a  future  battle  will  be  produced. 
A  new  system  must  demonstrate  its  value-added  warfighting  capability  prior  to  obtaining  ap¬ 
proval  to  expend  significant  resources  on  its  development  and  production. 

Where  and  how  will  this  be  accomplished?  The  DOD  is  creating  an  electronic  battlefield  that  will 
become  the  site  of  future  weapon  system  evaluations.  Virtual  prototypes  will  become  the 
means  through  which  the  warfighting  impact  of  each  existing  and  proposed  system  will  be  as¬ 
sessed.  Because  the  virtual  prototype  is  a  key  ingredient  in  this  new  acquisition  philosophy,  un¬ 
derstanding  its  heritage  and  future  potential  is  essential  for  all  participants  in  the  acquisition 
process. 

What  then  is  a  virtual  prototyfie?  According  to  the  Defense  Modeling  and  Simulation  Office,  it 
is  "a  computer  based  simulation  of  a  system  or  subsystem  with  a  degree  of  functional  realism 
that  is  conqiarable  to  that  of  a  physical  prototype."  This  report  explores  the  world  of  virtual 
prototypes. 


Chapter  One  provides  an  introduction  to  our  study  and  explains  our  research  methodology. 
Chapter  Two  contains  an  assessment  of  the  changing  DOD  environnnent  and  oudines  the  recent 
changes  in  acquisition  policy.  Included  is  a  summary  of  the  new  Science  and  Technology  Strat¬ 
egy  and  the  Seven  Thrusts  that  are  designed  to  provide  focus  for  the  development  community. 

SPECTRUM  OF  SYNTHETIC  ENVIRONMENTS 
In  Chapter  Three  we  provide  an  overview  of  the  synthetic  environment,  from  its  foimdation  to 
its  future.  Because  realistic  and  accurate  digital  representations  of  each  part  component  or  end 
product  being  designed  are  required,  Computer-Aided  Design/Computer- Aided  Manufactur¬ 
ing  (CAD/CAM)  provides  the  fundamental  basis  for  most  virtual  prototypes.  We  discuss  cur¬ 
rent  uses  of  this  technology  and  address  the  key  advances  that  are  being  used  to  create 
synthetic  environments  for  design  and  manufacturing.  The  dramatic  increases  in  computer 
processing  have  been  exploited  by  the  leading  suppliers  of  CAD/ CAM  systems,  and  almost  all 
now  have  the  ability  to  create  three-dimensional  drawings  that  can  be  rotated  for  better  view¬ 
ing.  Not  long  after  this  capability  was  introduced,  enhanced  capabilities  such  as  meshing,  solid 
modeling  and  finite  element  analysis  became  available  on  mainframe  computers.  Initially  these 
programs  resided  only  with  highly-trained  specialists  working  on  special  applications,  but  now 
more  robust  and  easier-to-use  software  has  dramatically  changed  this  situation.  The 
CAD/CAM  programs  such  as  Computer-Aided  Three  Dimensional  Interactive  Applications 
(CATIA)  and  Pro/Engineer  have  become  standard  engineering  design  tools  in  most  of  the  ma¬ 
jor  design  and  manufacturing  facilities  ttiat  we  visited.  New,  more  powerful  workstations  have 
now  made  it  possible  for  design  and  rrumufacturing  engineers  to  have  this  capability  at  their 
desks  and  the  mainframe  is  now  required  only  for  extremely  complex  or  massive  projects. 

During  our  on-site  visits  to  contractors  throughout  the  United  States,  we  were  able  to  observe 
this  powerful  capability  in  action.  The  largest  application  we  witnessed  was  at  the  Boeing  Air¬ 
craft  Company  where  approximately  2,200  workstations  and  eight  of  the  largest  mainframes 
IBM  builds  are  used  to  design  their  newest  commercial  aircraft;  the  Boeing  777.  Boeing  has  in¬ 
vested  approxirrrately  $100  rrrillion  in  this  capability  because  they  are  convinced  it  is  critical  to 
maintaining  the  competitive  advantages  needed  for  their  future  success.  Based  on  the  high  fi¬ 
delity  of  their  digital  design,  Boeing  has  decided  not  to  build  a  physical  mock-up  and  will  pro¬ 
ceed  directly  from  the  digital  model  to  the  manufacturing  floor.  We  were  able  also  to  observe 
smaller  contractors  drat  have  successfully  incorporated  digital  design  and  manufacturing  capa¬ 
bilities  similar  to  those  used  by  Boeing,  but  on  a  nrore  limited  investment  budget.  We  were  ex¬ 
tremely  impressed,  for  example,  by  the  excellent  results  the  small  engine  division  of  Kohler 
Corporation  has  achieved  widi  a  relatively  modest  investment  in  this  tedinology.  Corporate 
foresight  that  saw  the  potential  and  nrade  the  hardware  and  software  investment,  coupled  with 
the  hard  work  of  its  designers  and  manufacturing  persormel,  has  resulted  in  Kohler  Ireing  able 
to  produce  and  sell  one  of  the  best  small  engines  in  its  class.  They  have  not  only  been  able  to 
survive  in  a  very  competitive  environment  but  have  actually  gained  rrrarket  share  at  the  ex¬ 
pense  of  their  Japanese  rivals.  They  attribute  much  of  their  success  to  their  digital  design  capa¬ 
bilities  because  they  now  can  rapidly  evaluate  numerous  design  iterations  and  optimize  th^ 
for  performance  and  produdbility  before  building.  Eliminating  the  need  for  one  physical  pro- 
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totype  in  their  design  cyde  has  allowed  them  to  gain  a  competitive  advantage  by  being  able  to 
bring  newer/more  advanced  products  to  the  marketplace  in  less  than  half  the  time  it  pre¬ 
viously  required. 

We  have  also  induded  a  discussion  on  the  risks  associated  widi  the  use  of  these  new  engineer¬ 
ing  and  manufacturing  analysis  took.  The  collap>se  of  the  Hartford  Coliseum  "space-frame" 
roof  is  discussed  briefly  as  a  reminder  that  the  majority  of  all  engineering  failures  result  from 
faulty  judgments,  not  from  faulty  calculations. 

A  relatively  new  iimovation  called  stereolidiography  takes  a  digital  design  created  by  the 
CAD/CAM  process  and  uses  it  to  produce  a  plastic  prototype  rapidly,  eitirer  a  dimensionally 
scaled  model  or  a  limited-run  production  sample.  These  rapid  prototypes  facilitate  the  visuali¬ 
zation  process  that  supports  concurrent  engineering  by  allowing  engineers  to  assess  and 
modify  designs  better,  to  meet  user  requirements  and  manufacturing  capabilities.  Stereolithog¬ 
raphic  parts  also  make  it  easier  totest  accurately  for  proper  fit  and  interference  problems.  They 
can  be  used  to  enhance  communications  with  vendors,  especially  when  obtaining  quotations 
for  complex  parts.  Significant  savings  can  be  realized  ako  in  tooling  development  through  the 
use  of  stereolithography.  General  Motors,  for  example,  is  so  convinced  of  thk  benefit  that  it  has 
recently  decreed  that  all  park  requiring  tooling  must  employ  stereolithography. 

Probably  an  even  more  important  use  for  stereolithography  is  supporting  marketing  effork 
witii  potential  customeis.  No  longer  must  the  salesman  depend  on  an  artist's  conception;  with 
stereolithography,  the  customer  can  see  and  feel  the  new  product  before  starting  the  manufac¬ 
turing  process.  Thk  has  been  especially  useful  in  reducing  the  number  of  design  changes  that 
are  requested  late  in  the  development  process  and  cost  inordinate  amounk  to  implement. 

Many  engineers  believe  it  k  no  longer  necessary  to  produce  a  physical  prototype  because  new 
hardware  and  software  capabilities  now  permit  the  creation  of  a  virtual  prototype  that  is  even 
more  useful  than  one  created  from  stereolithography.  "1  don't  need  to  make  a  plastic  gear;  I 
know  what  gears  look  like.  I  want  to  see  die  areas  of  stress  so  I  can  optimize  ik  design,  weight, 
and  produdbility."  Statemenk  like  thk  illustrate  the  cotrfidence  engineers  are  starting  to  de¬ 
velop  in  the  use  of  virtual  prototypes  and  may  signal  tire  begiruiing  of  a  transition  away  from 
physical  prototypes.  As  dkcussed  earlier,  Boeing  made  a  dramatic  corporate  corrunitment  to 
tius  digital  conversion. 

Our  review  of  released  and  draft  DOD  policies  on  simulation  and  modeling  indicates  virtual 
prototypes  will  become  a  key  ingredient  in  the  weapon  system  evaluation  process  ako.  The  sci¬ 
ence  and  technology  (S&T)  strategy  stresses  the  importance  of  virtual  prototypes  and  Thrust 
Sx  and  Seven  specifically  address  their  application  to  the  acquisition  process.  The  Defense 
Modeling  and  Emulation  Office,  Advanced  Research  Project  Agency  (AREA),  and  the  military 
services  are  all  in  the  process  of  expanding  ttieir  use  of  virtual  prototypes  and  new  and  addi- 
tiorud  policy  guidance  k  expected  in  the  near  future. 
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The  "ultimate  computer  experierioe"  is  one  way  to  describe  the  emeiging  technology  that  con¬ 
stitutes  the  upper  end  of  the  spectrum  of  synthetic  environments.  Virtual  reality  is  a  subject  of 
enormous  curiosity  to  academia,  industry,  governments  and,  most  of  all,  the  media.  Because 
virtual  reality  offers  so  many  potential  new  uses  for  computer  technology  and  because  the  en¬ 
tertainment  industry  has  already  incorporated  many  of  these  features  in  its  latest  releases,  die 
term  "virtual"  has  become  a  key  ingredient  in  attracting  public  attention.  Hardly  a  day  goes  by 
without  a  newscast  or  magazine  article  that  announces  a  new  "virtual"  something:  virtual  de¬ 
sign,  virtual  product,  virtual  corporation  or  virtual  vision.  Behind  all  the  flashy  titles,  however, 
resides  a  nascent  technology  that  many  experts  at  the  universities  and  research  labs  we  visited 
believe  has  the  potential  to  be  one  of  the  single  most  powerful  computer  advancements  known 
to  man.  It  has  been  referred  to  as  the  ultimate  computer  interface  because  the  computer  will  be 
operated  with  natural  gestures  such  as  walking  around,  looking  around,  and  using  hands  to 
manipulate  digital  objects.  Dr.  Thomas  Furness,  Director  of  the  Human  Interface  Technology 
Laboratory  at  die  University  of  Washington,  believes  virtual  world,  virtual  environment  and 
virtual  reality  are  interchangeable  terms,  and  he  defines  them  as:  "The  representation  of  a  com¬ 
puter  model  or  database  in  the  form  of  a  system  of  virtual  images  which  creates  an  interactive 
environment  which  can  be  experienced  and/or  manipulated  by  the  user."  He  defines  virtual 
images  as  visual,  auditory  and  tactile  stimuli  whidi  are  transmitted  to  the  sensory  end  organs 
so  they  appear  to  originate  from  within  the  three-dimensional  space  surrounding  the  user.  To 
experience  virtual  reality  today,  the  participant  usually  must  put  on  some  type  of  head- 
mounted  display  with  a  position  sensor,  insert  a  hand  in  a  data  glove,  and  employ  the  services 
of  a  powerful  graphical  computer  with  image-rraidering  capabilities. 

In  the  virtual  reality  section  of  oiu  report,  we  summarize  many  of  our  first-hand  experiences 
with  the  maturity  of  hardware  and  software  used  to  create  virtual  reality.  Most  virtual  proto¬ 
types  we  have  discussed  do  not  meet  the  academic  definition  of  virtual  reality.  Immersion  and 
navigation  are  the  two  primary  characteristics  that  separate  virtual  reality  from  most  other 
types  of  computer  representations.  Immersion  is  the  sensation  the  participant  experiences  from 
being  surrounded  by  the  digital  world  or  environment.  The  images  are  projected  in  such  a 
marmer  that  tiie  human  eye  conveys  the  impression  you  are  inside  the  scene,  not  on  the  outside 
looking  in.  Navigation  is  the  ability  of  the  participant  to  move  aroimd  inside  the  digital  envi¬ 
ronment.  In  the  virtual  environments  we  observed  at  the  University  of  Washington,  the  partici¬ 
pant  can  "fly"  through  the  sky,  swim  up  to  and  around  as  well  as  "toudi"  the  digital  fish,  or 
walk  down  the  streets  of  a  "virtual"  dty. 

We  witnessed  a  much  more  powerful  virtual  reality  computing  capability  at  the  research  facil¬ 
ity  of  the  University  of  North  Carolina  at  Chapel  Hill.  This  facility  is  concentrating  on  develop¬ 
ing  a  powerful  computer  processing  capability  to  support  higher^resolution  image  generation. 
The  Pixel-Planes  5  multicomputer  system  they  have  developed  has  the  highest  quality  graphics 
of  any  location  we  visited  The  computei^generated  digital  topography  scene,  for  example, 
looked  exactly  like  a  photograph  taken  witti  a  high-powered  lens.  It  was  especially  inq>ressive 
because  the  digital  images  had  not  been  scanned  in  originally. 
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In  the  final  section  of  this  chapter,  we  discuss  modeling  and  simulation  and  the  issues  fadng 
die  DOD  simulation  conununity.  We  provide  a  technology  assessment,  and  briefly  describe  two 
ARPA  programs  that  are  using  current  technology  to  inclement  virtual  prototypes  in  EKDD 
simulations. 

Modeling  and  simulation  are  related  but  not  interchangeable.  Modeling  is  the  development  of 
equations,  constraints  and  logic  rules,  while  simulation  is  the  exercising  of  models  over  time. 
Emulation  contains  models  but  models  do  not  contain  simulations.  Informal  DOD  papers  have 
separated  simulation  into  three  categories;  oonstructive,  virtual  and  live.  A  brief  description  of 
each  is  provided  below. 

CONSTRUCTIVE:  Waigames,  models  and  analytic  tools  developed  by  the  individual  Services. 

VIRTUAL  Systems  simulated  both  physically  and  by  computer.  Real  people  fight  on  synthetic 
battlehelds,  interacting  with  eadi  other  and  widi  artifacts  in  the  simulation.  Examples  indude 
individual  aircraft  simulators,  tank  simulators  and  virtual  prototypes. 

LIVE:  Operatiorrs  with  live  forces  and  real  equipment  in  the  air,  on  the  ground,  on  and  below 
the  sea.  Also  induded  in  ttiis  category  are  hardware  prototypes  on  instrumented  ranges.  Exam¬ 
ples  indude  exercises  such,  as  REFORGER  and  training  rotations  at  the  National  Training  Cen¬ 
ter. 

Future  DOD  acquisition  evaluations  will  probably  utilize  one  or  more  of  these  simulation  cate¬ 
gories  and  most  major  weapon  system  acquisitions  will  be  accomplished  usually  by  utilizing  a 
combination  of  all  categories  in  die  equirements  definition,  development,  production,  train¬ 
ing,  and  operational  phases  of  the  program. 

The  Simulation  Networking  (SIMNET)  Project  is  a  joint  Army  and  ARPA  project  that  uses  dis¬ 
tributed  simulation  as  both  a  prototype  training  device  and  a  new  technology  testiTed.  The 
ARPA  has  used  this  program  as  a  vehide  to  demonstrate  new  technology  assodated  with  a  dis¬ 
tributed  simulation  architecture.  The  SIMNET  has  evolved  from  a  training  device  to  a  means 
for  evaluating  acquisition  alternatives  and,  as  sudi,  is  the  genesis  for  EKDITs  new  simulation  in¬ 
itiatives.  Battlefield  Distributed  Simulation-Development  (BDS-D)  is  a  follow-on  development 
network  based  on  the  success  of  SIMNET.  It  will  focus  on  providing  a  warfighting  assessment 
capability  network  using  a  soldiei^in-fiie-loop  virtual  reality  approach.  The  BDS-D  will  address 
the  issues  of  verification,  validation  and  accreditation  of  distributed  interactive  simulation 
models,  as  well  as  DOD  and  industry  standards  and  protocols  that  are  used  for  the  distributed 
interactive  simulation  architecture. 

SYNTHETIC  ENVIRONMENTS  IN  ACQUISITION 
In  Chapter  Four,  we  review  briefly  the  DOD  acquisition  process  for  tiie  benefit  of  readers  who 
may  not  be  familiar  with  dre  milestone  approach  to  acquisition.  Selected  DOD  acquisition  poli- 
des  "Translating  Operational  Needs  into  Stable,  Affordable  Programs"  and  "Acquiring  Quality 
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Products"  are  described  to  provide  a  basis  for  discussing  what  we  believe  are  functional  areas 
where  the  acquisition  community  may  benefit  from  the  expanded  use  of  virtual  prototypes  in 
the  acquisition  process. 

The  DODD  5000.1  requires  a  Mission  Need  Statement  (MNS)  to  be  expressed  by  the  user  com¬ 
munity  in  broad  operational  capability  terms.  The  steps  involved  in  the  MNS  approval  process 
and  the  actions  required  to  obtain  a  Milestone  I  (New  Start)  decision  are  illustrated  and  dis¬ 
cussed.  Also  in  this  section  is  a  brief  discussion  of  DOD  guidance  on  acquisition  strategies,  exit 
criteria  and  risk  management.  At  the  New  Start  milestone  decision,  broad  objectives  for  cost, 
schedule  and  performance  parameters  are  established.  These  parameters  are  reviewed  and  re¬ 
fined  at  eadi  subsequent  milestone  review  and  provide  the  basis  for  program  baselines.  The 
balance  of  this  chapter  discusses  functioned  areas  associated  with  the  acquisition  process  and 
the  potential  benefits  that  each  might  derive  from  the  use  of  virtual  prototypes.  The  five  func¬ 
tional  areas  are:  analysis,  research  and  development,  testing  and  evaluation,  production  and  lo¬ 
gistics,  and  training. 

In  the  analysis  area,  virtual  prototypes  can  be  used  to  conduct  electronic  battlefield  evaluations 
that  will  assist  in  determining  the  type  <md  number  of  weapon  systems  required  to  support 
military  participation  in  future  conflicts.  Weapon  system  analysis  can  be  expanded  to  assist  in 
the  force  structure  analysis  associated  with  the  maintenance  and  transportation  requirements 
necessary  to  support  these  new  warhghting  systems.  Because  virtual  prototypes  are  digital, 
they  can  provide  excellent  support  to  configuration  analysis  and  cost  analysis  activities.  Trade¬ 
off  studies  and  sensitivity  aiudysis  can  benefit  from  tttis  new  technology  because  it  can  support 
the  evaluation  of  multiple  configurations  as  well  as  permit  the  performance  assessments  to  be 
conducted  in  a  controlled  and  repeatable  environment.  Campaign  analysis  can  benefit  from 
modeling  and  simulation,  but  we  do  not  believe  it  will  receive  any  significant  benefits  from  the 
use  of  virtual  prototypes.  This  assessment  is  based  on  the  fact  that  it  is  not  currently  practical  or 
cost-effective  to  involve  hundreds  or  thousands  of  man-the-loop  virtual  prototypes  in  the  ex¬ 
tended  analysis  that  would  be  required  for  a  campaign  simulation.  Virtual  prototypes  can  be 
extremely  beneficial  in  achieving  system  advocacy  because  they  suppiort  the  "visualization"  of 
the  new  system.  Program  managers  will  now  be  able  to  have  the  ultimate  marketing  tool,  a 
computer-based  animated  model  of  their  system  that  they  can  carry  with  them  and  demon¬ 
strate  whenever  ffie  opportunity  presents  itself. 

The  benefits  to  be  derived  from  the  use  of  virtual  prototypes  in  the  research  and  development 
area  are  extensive.  Eariy  visualization  of  the  product  to  be  produced  greatly  assists  the  user  in 
defining  his  requirements  accurately  and  helps  communication  between  the  developer  and  the 
user  communities.  Because  the  virtual  prototype  is  noimally  refined  through  the  use  of 
CAD/ CAM  data,  it  provides  an  excellent  means  to  maximize  the  productivity  of  eadi  member 
on  an  integrated  product  development  team.  Functional  representatives  are  able  to  understand 
better  the  concerns  and  needs  of  their  counterparts  at  a  very  early  stage  in  the  design  process. 
Because  historical  data  has  shown  that  more  than  80  percent  of  the  total  cost  of  a  system  is  de¬ 
termined  by  decisions  made  prior  to  the  Engineering  and  Manufacturing  Development  phase. 
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optimizing  these  critical  decisions  is  extremely  important.  The  test  and  evaluation  community 
can  benetit  also  from  the  use  of  virtual  prototypes  because  they  can  be  used  to  obtain  early  op¬ 
erational  assessments  of  the  system.  The  user  can  operate  flie  virtual  prototype  for  a  stand-alone 
assessment,  and  it  can  be  connected  to  the  electronic  battlefield  for  warfighting  evaluations. 

As  'mentioned  under  research  and  development  benefits,  obtaining  early  assessments  of  a  de¬ 
sign  is  extremely  valuable  because  such  a  large  part  of  the  total  cost  is  determined  during  the 
initial  phases  of  a  product  development.  Developmental  and  operational  testing  can  also  bene¬ 
fit  from  tile  use  of  virtual  prototypes.  By  using  a  virtual  prototype,  the  tester  can  optimize  his 
test  scenario  and  data  collection  to  support  milestone  decisions.  It  should  be  easier  for  the  test 
community  to  collect  various  types  of  performance  data  using  a  virtual  prototype  because  it  is 
digital  and  thus  easier  to  instrument  In  many  programs,  it  may  be  possible  to  eliminate  the 
need  for  a  physical  prototype  to  support  testing.  Boeing  Aircraft  Company,  for  example,  is 
building  tiieir  new  Boeing  777  aircraft  directly  from  tiieir  digital  model,  no  physical  mo^-ups 
will  be  built  They  also  are  using  their  digital  design  information  with  specialized  analysis  soft¬ 
ware  to  perform  extensive  structural  and  electrical  evalirations.  They  believe  they  can  use  these 
results  to  build  a  deliverable  product  that  will  have  a  high  probability  of  passing  all  the  techni¬ 
cal  and  operatioruti  tests. 

Production  and  logistics  can  benefit  from  the  use  of  virtual  prototypes  because  the  digital  de¬ 
signs  for  the  individual  parts  have  been  optimized  for  produdbility  via  use  of  CAD/CAM  soft¬ 
ware.  Tooling  design  can  be  started  also  at  an  early  stage  throt  .gh  use  of  the  virtual  prototypes 
digiteJ  information  and  visualization  capabilities.  Concurrent  engineering  can  benefit  from  vir¬ 
tual  prototypes  because  they  provide  a  means  to  see  the  product  that  is  being  designed.  Visu¬ 
alization  has  proven  to  be  a  powerful  medium  ttiat  dramatically  improves  the  communication 
between  concurrent  engineering  functional  team  members.  Logistics  will  benefit  from  the  use 
of  virtual  prototypes  because  they  allow  maintenance  requirements  to  be  evaluated  early  in  the 
design  process.  Boeing  and  Sikorsky  have  used  virtual  prototypes  to  enhance  their  design  for 
subsequent  maintainability  by  having  nraintenance  personnel  perform  typical  maintenance  op¬ 
erations  on  their  virtual  prototype  and  provide  feedback  to  the  designers  prior  to  fieezing  the 
design. 

The  benefits  virtual  prototypes  can  offer  to  trairung  are  almost  unlimited.  Simulators  were  de¬ 
veloped  specifically  for  training,  and  have  been  extremely  valuable  in  optimizing  the  benefits 
received  for  each  training  dollar  spent  High-fidelity  trainee-in-tiie-loop  simulations  that  in¬ 
volve  virtual  prototypes  will  be  the  primary  training  mechartism  in  the  future,  especially  if 
funding  for  real-world  training  exercises  continues  to  be  reduced.  Because  tire  benefits  of  simu¬ 
lation  are  so  well  documented  and  accepted,  we  did  not  conduct  specific  research  in  the  use  of 
virtual  prototypes  in  this  area.  Additional  research  should  be  conducted  in  the  use  of  virtual 
prototypes  in  general  education. 


EXAMPLES  OF  SYNTHETIC  ENVIRONMENTS 
In  Chapter  Five  we  provide  an  overview  of  our  visits  to  industry,  government  and  academic  fa¬ 
cilities  that  are  developing  or  utilizing  virtual  prototypes.  This  portion  of  our  report  constitutes 
the  primary  database  from  which  our  comments/assessments  in  earlier  sections  have  been 
drawn.  We  have  been  extremely  fortunate  in  the  cooperation  we  have  received  while  conduct¬ 
ing  this  research.  Candor  and  the  willingness  to  share  real-world  experiences  witt\  us  are  two 
attributes  that  characterize  best  each  of  our  face-to-face  interviews  with  persormel  involved  in 
die  use  of  virtual  prototypes.  We  have  included  information  from  our  on-site  observations  at 
Boeing,  General  Dynamics  Electric  Boat  Division,  Sikorsky,  Kohler,  ARPA,  NASA/ Ames,  Uiu- 
versity  of  North  Carolina  (Chapel  Hill),  University  of  Washington  Human  Interface  Technology 
Laboratory,  and  the  U.S.  Army  Night  Vision  and  Electronic  Sensors  Directorate.  Based  on  our 
first-hand  observations,  virtual  prototypes  are  being  used  in  everything  from  the  design  and 
manufacture  of  lawnmower  engines  to  the  design,  marketing,  test  and  manufacture  of  the 
world's  most  sophisticated  aircraft  If  you  have  any  doubts  about  the  potential  uses  and  bene¬ 
fits  of  virtual  prototypes,  please  read  our  discussion  on  Boeing  or  Sikorsky. 

CONCLUSIONS  AND  RECOMMENDATIONS 
In  the  final  chapter  of  our  report  we  set  forth  our  conclusions  on  the  status  of  virtual  proto¬ 
types  and  make  recommendations  that  address  acquisition  policy,  program  managers  and  in¬ 
dustry.  Our  conclusions  and  recommendations  are  presented  in  a  summarized  fashion  below. 

Conclusions 

1.  Virtual  prototypes  can  eliminate  the  need  for  some  and,  in  certain  specific  cases,  all  physi¬ 
cal  prototypes. 

2.  Simulation  still  contains  risks  that  should  not  be  overlooked. 

3.  Rapid  prototyping  techniques  can  greatly  accelerate  the  production  of  new  commodities. 

4  \firtual  prototyping  can  provide  a  clear,  competitive  edge  to  companies  who  embrace  and 
successfully  implement  its  features. 

5.  Virtual  reality  has  great  potential,  but  it  is  not  clear  when  DOD  will  be  able  to  benefit  from 
die  use  of  this  emerging  technology. 

6.  Verification,  validation  and  accreditation  of  synthetic  battlefields  and  virtual  weapon  sys¬ 
tems  is  a  major  challenge,  and  substantial  investment  will  be  required  to  enhance  our  cur¬ 
rent  capability  in  this  area. 

7.  Computing  power  available  today  falls  short  of  that  needed  to  produce  high-cjuality  im¬ 
ages  for  syndietic  environments,  and  implementing  a  desirable  level  of  realism  v^l  recpire 
a  significant  investment  in  the  development  of  hardware  and  software. 


8.  Virtual  prototypes  can  be  a  valuable  management  tool  for  program  nunagers  to  use  in 
identifying  and  managing  program  risks. 

9.  Major  weapon  system  acquisition  decisions  in  the  near  future  will  be  influenced  signifi¬ 
cantly  by  the  performance  of  virtual  prototypeson  synthetic  battlefields. 

10.  A  virtual  prototype  can  be  a  positive  influence  program  support  at  all  levels  of  the  DOD 
acquisition  process. 

11.  Virtual  prototypes  can  help  the  contractor  and  government  program  manager  understand 
new  doctrinal  concepts  and  the  warfighting  impact  of  new  systems  by  providing  a  means 
for  the  designers  to  visualize  and  interact  with  their  product. 

12.  Virtual  prototypes  can  provide  developmental  and  operational  testers  with  the  ability  to 
conduct  meaningful  evaluations  and  can  aid  in  the  design  of  tests  performed  during  each 
phase  of  an  acquisition. 

13.  Concurrent  engineering  can  result  in  products  which  incorporate  state-of-die-art  technol¬ 
ogy  and  satisfy  customer  needs  and  manufacturing  capabilities. 

14.  Successful  implementation  of  virtual  prototyping  requires  a  sigruficant  commitment  from 
senior  management  because  the  implementation  and  utilization  process  involves  a  major 
cultural  change  for  the  oiganization. 

15.  The  modeling  and  simulation  infrastructure  within  DOD  needs  to  be  improved. 

16.  If  distributed  interactive  simulation  is  used  to  make  acquisition  decisions,  the  elements  of 
the  simulation  netwoik  need  to  provide  an  environment  sufficiently  accurate  so  results  can 
be  used  witti  oontidenoe. 

17.  The  understanding  of  weapon  systems  and  processes  gained  by  using  virtual  prototypes 
will  enhance  the  fundamental  understanding  of  systems,  subsystems  and  manufacturing 
processes  and  make  it  easier  to  optimize  designs  for  performance,  produdbility  and  reli¬ 
ability. 

Recommendations 

Acquisition  Policy 

1.  Virtual  prototypes  should  be  encouraged  in  lieu  of  physical  prototypes  whenever  possible, 
and  dual-use  funding  should  be  taigeted  to  this  area. 

2.  Virtual  reality  has  great  potential,  but  when  DOD  will  benefit  from  this  tedinology  is  not 
clear,  \firtual  reality  research  should  be  continued. 
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3.  An  organization  needs  to  be  established  with  the  responsibility  for  establishing  standards 
and  common  tools  for  verification,  validation  and  accreditation  of  all  synthetic  environ¬ 
ments. 

4.  Rapid  prototyping  tools  and  techniques  greatly  accelerate  the  development  of  new  prod¬ 
ucts  and  should  be  required  in  contracts  for  parts  and  subsystems  wherever  possible.  The 
use  of  stereolithography  and  other  similar  technologies  should  be  encouraged. 

5.  Software  development  tools  which  support  the  rapid  construction  of  battlefield  simula¬ 
tions  need  to  be  developed.  They  must  look  real  and  must  present  the  same  conditions  to 
all  participants.  The  environments  must  provide  senuautomated  forces  which  mimic  hu¬ 
man  behavior.  Finally  these  models  of  realistic  human  performance  and  decision-making 
need  to  be  validated. 

6.  Incorporate  virtual  prototypes  in  developmental  and  operational  test  plans  as  a  substitute 
for  physical  protot^^es  wherever  possible  and  use  them  to  aid  in  the  design  of  the  tests 
that  will  be  performed  during  each  phase  of  an  acquisition. 

7.  Establish  a  modeling  and  simulation  infrastructure  responsible  for  data  communication 
standards  and  tools  which  do  not  exist  today. 

8.  The  distributed  interactive  simulation  environment  must  be  validated  and  verified  to  en- 
sirre  that  it  is  sufficiently  accurate  so  simulation  results  can  be  used  with  confidence 

Program  Managers 

1.  Virtual  prototypes  are  a  powerful  tool  for  managing  program  risk.  Virtual  prototypes 
should  be  used  to  measure  performance  against  milestone  decision  criteria.  They  can  be 
used  to  test  the  system  or  certain  high-risk  subsystems  against  certain  simulated  threats,  to 
assess  the  effectiveness  of  the  technology  and  to  evaluate  the  feasibility  of  the  design  for 
produdbility. 

2.  Virtual  prototypes  are  useful  in  obtaining  and  maintaining  system  support.  They  can  have 
a  positive  influence  on  product  support  at  all  levels  of  the  acquisition  process.  Use  them  to 
demonstrate  the  "value-added"  capabilities  of  your  system  while  at  the  same  time  con¬ 
vincing  the  audience  that  the  technical  and  financial  risks  associated  with  obtaining  this  ca¬ 
pability  are  reasonable,  ^firtual  prototypes  can  be  used  also  to  increase  user  involvement  in 
the  development  process  by  providing  a  better  foundation  for  user  and  developer  commu¬ 
nications. 

3.  Plan  to  have  your  system  tested  in  a  simulated  battlefield  early  on.  Find  out  your  system's 
strengths  (warfighting  value-added  characteristics)  to  support  your  program  advocacy  ac¬ 
tivities  and  identify  potential  weaknesses  so  they  can  be  corrected  as  soon  as  possible. 
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4.  Virtual  prototjqjing  activities  support  the  DOD  dual-use  efforts.  Ask  to  formally  participate 
in  this  program  and  seek  additioncd  funds  to  support  your  participation. 

Industry 

1.  Virtual  prototyping  provides  a  clear  competitive  edge  to  companies  who  embrace  and  im¬ 
plement  it  successfully.  Encourage  and  support  its  use  at  every  opportunity. 

2.  Concurrent  engineering  is  an  absolute  requirement  for  competitiveness  in  the  1990s.  Vir¬ 
tual  protot)q)ing  will  facilitate  the  adoption  of  this  concept 

3.  Senior  management  support  is  required  for  implementation  of  successful  virtual  prototyp¬ 
ing.  The  conversion  to  digital  design  concepts  will  involve  a  major  cultural  change,  and  a 
sigmhcant  transition  period  should  be  allowed  prior  to  mandatory  conversion. 
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WhUe  theoretically  and  technically  telemion  vmy  be  feasible, 
commercially  and  financially  1  consider  it  an  impossMity, 
a  development  of  which  we  need  waste  little  time  dreaming. 

—  Lee  DeForest,  Physicist 
1926 


Chapter  1 

INTRODUCTION 


We  undertook  this  research  project  to 
assess  the  feasibility  of  using  vir¬ 
tual  prototypes  in  the  weapon  sys¬ 
tems  acquisition  process.  CXn  goal  was  to 
identify  and  assess  current  applications  of  vir¬ 
tual  prototyping  by  commercial  companies, 
defense  contractors  and  universities.  The  De¬ 
fense  Science  Board  and  die  Defense  Model¬ 
ing  and  Simulation  Office  are  confident  that 
virtual  prototyping  can  signihcantly  influence 
acquisition  in  die  future.  We  were  skeptical 
about  the  usefulness  of  virtual  prototyping 
and  curious  to  see  who,  if  anyone,  was  using 
virtual  prototyping  as  an  aid  in  design,  manu¬ 
facturing  and  testing  of  commercial  or  de¬ 
fense  systems  and  to  examine  their 
experience  widi  virtual  prototyping.  We  also 
wanted  to  know  what  meaning  people  from 
various  industries  and  backgrounds  give  to 
the  term  virtual  prototype  and  what  one  can 
realistically  exp^  its  usefulness  to  be.  We 
were  interested  in  identifying  the  key  risks 
and  challenges  associated  with  virtual  proto¬ 
typing.  Our  charter,  then,  was  to  assess  and 
describe  the  current  state  of  virtual  prototyp¬ 
ing. 

METHODOLOGY 

We  approached  diis  project  from  four  direc¬ 
tions.  First,  while  at  die  Harvard  Business 
School,  we  discussed  with  faculty  members 


and  associates  from  commercial  sectors  our 
topic  and  its  relevance  in  today's  business  en¬ 
vironment.  A  primary  reason  for  puisuing  the 
topic  was  the  emphasis  Harvard  placed  on 
competitive  advantage.  Case  studies  of  com¬ 
mercial  products  emphasized  the  importance 
of  achieving  this  advantage.  The  recent  de¬ 
cline  of  our  nation's  manufacturing  base  re¬ 
flects  the  difficulty  of  competing  in  today's 
international  markets;  thus,  the  exploration  of 
techniques  to  enhance  competitive  advantage 
seemed  particularly  relevant. 

Second,  we  conducted  an  extensive  literature 
review  that  identified  more  than  500  articles 
of  possible  relevance  including  books,  peri¬ 
odicals,  research  reports,  government  policy 
letters,  instructions  and  regulations.  We  used 
these  to  identify  documents  containing  infor¬ 
mation  pertinent  to  our  research  effort  Ulti¬ 
mately,  we  relied  directly  on  more  than  150 
documents  for  this  report 

Our  background  research  on  virtual  proto¬ 
types  indicated  that,  to  date,  no  one  had  con¬ 
ducted  research  which  addressed  a  broad 
range  of  applications  and  the  implications  of 
virtual  prototypes  on  the  defense  acquisition 
process.  Information  on  current  applications 
is  extremely  limited.  While  a  great  deal  of 
data  exists  on  the  potentials  of  virtual  proto- 
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t)rping,  virtual  reality  and  synthetic  environ¬ 
ments,  there  is  little  concrete  information  on 
what  has  been  accomplished  The  most  bene¬ 
ficial  aspect  of  this  report;  therefore,  may  be 
the  compilation  of  information  on  significant 
applications  of  virtual  prototyping.  Com¬ 
ments  from  practitioners  were  especially 
helpful  and  could  not  have  been  collected 
wi^out  the  on-site  interviews  that  are  the  ba¬ 
sis  for  much  of  the  information  in  this  report. 
Accordingly,  this  study  is  important  becaixse 
the  information  collected  is  not  available  else¬ 
where  and  also  because  it  is  particularly  rele¬ 
vant  to  today's  defense  acquisition  p>olicy 
makers. 

Third,  we  developed  a  survey  form  as  a  guide 
to  collecting  information  from  the  more  than 
50  individuals  we  interviewed  for  the  project. 
Our  objective  was  to  identify  and  assess  ap¬ 
plications  of  virtual  prototyping;  however,  we 
soon  realized  the  survey  was  overiy  restric¬ 
tive  in  situations  like  at  The  Boeing  Aircraft 
Company,  Sikorsky  and  The  Kohler  Com¬ 
pany,  where  virtual  prototyping  is  being  used 
extensively,  and  too  accommodating  for  com¬ 
panies  with  little  or  no  experience.  Accord¬ 
ingly,  we  used  the  survey  as  a  guide  to  ensure 
we  addressed  all  the  relevant  points  in  our  in¬ 
terviews,  but  not  as  the  basis  from  which  sta¬ 
tistical  analysis  would  be  performed. 

Hnally,  we  conducted  more  than  50  inter¬ 
views,  lasting  from  several  hours  to  several 
days  widi  individuals  from  academia,  gov¬ 
ernment  and  commercial  sectors  involved  in 
modeling,  simulation,  or  virtual  reality  and 
virtual  prototyping.  We  spoke  with  senior  re¬ 
search  scientists,  senior  acquisition  ofridals, 
senior  vice  presidents,  program  managers 
and  design  and  manufacturing  engineers.  We 
collected  as  much  information  as  possible 
from  these  individuals  on  their  experiences, 
good  and  bad,  widi  simulation.  We  asked  nu¬ 
merous  questions,  listened,  and  learned  a 
great  deal  about  this  new  design  and  manu¬ 


facturing  process.  We  witnessed  numerous 
demonstrations  of  d\e  latest  tools  and  tech¬ 
nologies,  and  by  wearing  head-mounted  dis¬ 
plays  we  were  able  to  experience  firsthand 
the  new  worid  of  virtual  reality. 

ASSUMPTIONS 

We  have  assumed  the  decreasing  defense 
budget  trend  will  continue  for  the  foreseeable 
future.  Indications  are  that  the  defense  budget 
will  come  under  ever-increasing  pressures  as 
Congress  and  the  President  attempt  to  de¬ 
crease  the  national  budget  deficit,  while  at  the 
same  time  increasing  expenditures  on  sodal 
and  health  care  programs,  \5rtual  prototypes 
facilitate  the  integration  of  design  and  manu¬ 
facturing  personnel  to  ensure  engineering  de- 
sifT  .  are  producible.  Because  this  capability 
sU|.>ports  a  rapid  transition  to  production,  it 
;Ma  prove  beneficial  to  the  industrial  base 
should  world  events  force  us  to  once  again 
man  the  ramparts  with  men  and  ecpiipment. 
This  is  especially  true  if  signiricant  reductions 
to  oxu-  defense  manufacturing  capability  con¬ 
tinue.  Because  DOD  must  maintain  its  techiu- 
cal  superiority  so  it  can  defend  the  nation 
with  a  dramatically  decreased  military  struc¬ 
ture,  maximum  return  for  every  dollar  in¬ 
vested  in  research  and  development  is 
essential.  We  believe  virtual  prototypes  are  vi¬ 
tal  to  this  effort 

PROBLEM  BACKGROUND 
Fundamental  changes  are  taking  place  in  the 
defense  acquisition  process.  Resource  con¬ 
straints,  rapicUy  expanding  cortunercial  com¬ 
puter  capabilities  and  a  new  acquisition 
strategy  that  expands  the  use  of  tedmology 
demonstrations  have  dramaticaliy  increased 
the  importance  of  synthetic  envirorunents,  or 
simulations,  in  the  acquisition  of  new  weapon 
systems.  Virtual  prototypes  are  a  key  compo¬ 
nent  of  this  envirorunent  and  provide  simula¬ 
tions  with  a  high  degree  of  realism.  What  is  a 
virtual  protot)^?  According  to  the  Defense 
Modeling  and  Simulation  Office,  it  is  "a  com- 
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puter-based  simulation  of  a  system  or  subsys¬ 
tem  widi  a  degree  of  functional  realism  diat  is 
comparable  to  that  of  a  physical  prototype." 

This  report  explores  the  world  of  virtual  pro¬ 
totypes.  It  identifies  and  discusses  current  ap¬ 
plications  of  virtual  prototypes  in  the 
commercial  maiketplace,  defense  industry 
and  in  university  research  centers.  Our  re¬ 
search  assesses  the  implications  of  synthetic 
environments  on  the  acquisition  process  by 
evaluating  the  functional  areas  involved  in 
each  step  of  the  process.  It  concludes  with  rec- 


onunendations  on  how  the  DOD  acquisition 
process  can  be  improved  and  how  program 
managers  can  use  virtual  prototypes  to  man¬ 
age  their  programs.  It  also  identifies  the  chal¬ 
lenges  associated  with  full  implementation  of 
virtual  prototypes.  Our  approach  is  descrip¬ 
tive  in  nature  and  makes  maximum  use  of 
charts,  diagrams  and  photographs.  Appendix 
D  contains  a  glossary  of  terms  commonly 
used  in  describing  computer-based  simula¬ 
tions  to  aid  readers  new  to  this  revolutionary 
world  of  simulation. 


Introduction  -  3 


Virtual  Prototyping:  Concept  to  Production 


We  must  not  be  misled  to  our  own  detriment 
to  assume  that  the  untried  machine  can  displace 
the  proved  and  tried  horse. 

—  MG  John  K.  Herr,  USA 
1938 


Chapter  2 

BACKGROUND 


Once  upon  a  time,  that  there  was  an 
enemy  was  basis  for  an  ever-increas¬ 
ing  need  to  develop  and  field  the 
world's  best  military  hardware.  The  acquisi¬ 
tion  process  was  relatively  straightforward  in 
that  the  user  community  identified  a  "need" 
for  a  certain  capability,  based  on  die  assess¬ 
ment  of  the  enemy's  current  and  projected  ca¬ 
pabilities.  The  DOD  weapon  systems 
acquisition  community,  government  and  in¬ 
dustry  acted  immediately  to  produce  a  sys¬ 
tem  to  fulfill  the  need.  The  enemy  responded 
by  enhancing  its  capability  through  real  and 
imaginary  developments.  This  caused  the 
DOD  user  to  realize  the  current  or  near-future 
capability  was  no  longer  sufficient.  New 
threats  generated  new  needs  which  became 
new  acquisitions,  and  the  circular  process 
evolved  into  the  structured  DOD  acquisition 
process  of  the  Cold  War  era. 

Then  the  urtHinkable  happened!  The  enemy 
decided  it  didn't  want  to  play  diis  game  any¬ 
more.  Who  could  have  possibly  predicted  the 
international  events  of  the  last  four  years? 
Democratic  movements,  coupled  wift  the 
continuing  failures  of  communist-based  re¬ 
gimes  to  fulfill  the  economic  and  political 
needs  of  their  constituents,  led  to  the  collapse 
of  the  Warsaw  Pact.  The  infamous  Berlin  Wall 
was  shattered  and  the  small  concrete  pieces 
became  best  sellers  in  gift  shops  throughout 
the  worid.  Once  the  Warsaw  Pact  collapsed. 


the  Soviet  Union  began  to  unravel,  finally  dis¬ 
integrating  in  December  1991.  New  "inde¬ 
pendent"  states  have  emeiged  in  its  place  and 
each  has  its  own  agenda.  Some  want  weapons 
of  war  and  some  do  not  All,  however,  want 
to  deteimine  their  own  future  and  will  no 
longer  submit  to  the  desires  of  the  Commu¬ 
nist  party. 

Not  long  after  the  Wall  collapsed,  the  worid's 
stability  was  threatened  by  ^e  Iraqp  invasion 
of  Kuwait.  A  worldwide  coalition  came  to¬ 
gether  under  U.S.  leadership  and  through  use 
of  combined  military  forces  restored  Kuwait 
independence.  This  historic  event  was  a  mile¬ 
stone  in  international  cooperation  and,  as 
such,  has  established  the  framework  for  fu¬ 
ture  coalition  efforts.  The  shifts  in  the  strate¬ 
gic  environment  have  been  momentous  as 
well  as  fundamental.  Strategic  nuclear  forces 
are  being  reduced  and  all  tactical  nuclear 
weap>ons  have  been  removed  from  U.S.  ships 
at  sea.  The  US.  Army  is  a  nonnuclear  force 
and  all  ground-launched  batdefield  nuclear 
weapons  are  being  eliminated.  The  Secretary 
of  Eiefense  in  his  1993  Aimual  Report  to  the 
President  and  the  Congress  stated  the  follow¬ 
ing: 

Today  the  United  States  and  its  allies 
are  more  secure,  and  the  promise  of  de¬ 
mocracy  is  more  real,  than  at  any  time 
in  recent  memory.  America  owes  its 
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armed  forces  and  their  families  a  debt  of 
gratitude  for  that  achievement.  Their 
service  and  dedication  have  been  the 
backbone  of  this  nation's  freedom 
throughout  the  long  years  of  Cold  War 
and  into  the  new  era.  America's  mili¬ 
tary  strength  remains  essential  as  we 
face  the  uncertainties  and  challenges 
that  lie  ahead. 

He  indicated,  also,  that  the  world  is  still  a 
dangerous  place.  Although  we  no  longer  face 
the  threat  of  a  global  war  beginning  in  the 
Fulda  Gap,  we  do  face  the  possibility  of  seri¬ 
ous  regional  conflicts.  They  may  be  triggered 
by  one  or  more  events,  often  hard  to  identify 
in  advance,  and  possibly  extremely  difficult 
to  diffuse  due  to  the  spread  of  hig^-teduiol- 
ogy  weapons.  Nuclear,  chemical  and  biologi¬ 
cal  weapons  which  can  be  combined  with 
long-range  ballistic  missiles  exacerbate  the 
dangers  that  can  be  associated  with  the  re¬ 
gional  coirflids  of  the  future. 

DOD  STRATEGY/FORCE 
STRUCTURE 

The  DOD  has  developed  a  comprehensive 
new  security  strategy  to  deal  with  this  new 
environment.  It  is  designed  to  meet  the  near- 
term  challenges  of  regional  conflict  while  si¬ 
multaneously  building  the  foundation  for 
long-term  security  in  a  coirstantly  changing 
global  enviroirment.  The  following  quotation 
from  the  Secretary  of  Defense  Atmual  Report 
provides  the  reader  with  an  overview  of  how 
this  strategy  will  impact  the  military. 

Today  it  is  providing  the  guidance  to 
refocus  defense  resources  and  restruc¬ 
ture  the  military  for  a  new  and  different 
security  environment.  We  have  used  the 
new  strategy  as  a  foundation  to  plan 
deep  but  carefully  focused  reductions  in 
our  force  structure.  The  goal  is  a 
smaller  but  still  capable  force  that  pre¬ 
serves  essential  combat  capability.^ 


DOD  MANAGEMENT  AND 
ACQUISITION  STRATEGY 
Reform  efforts  are  underway  in  DOD  to  con¬ 
solidate  financial  accoimting,  corporate  infor¬ 
mation  maruigement  and  other  common 
functions  and  apply  efficient  business  prac¬ 
tices  to  reduce  costs.  This  increased  efficiency 
should  permit  future  DOD  budgets  to  focus 
on  training,  support  and  the  development  of 
advanced  weapon  systems.  A  new  strategic 
approadr  has  ^so  been  applied  to  DOD  ac¬ 
quisitions.  Procedures  governing  acquisitions 
are  being  simplified  and  an  increased  focus 
has  been  placed  on  technology  research  and 
development.  The  production  of  weapon  sys¬ 
tems,  both  type  and  number,  is  being  dra¬ 
matically  reduced  since  near-term  threats  are 
considered  small  when  compared  to  ours  and 
our  allies'  combined  capabilities.  Inherent  in 
this  revised  acquisition  strategy  is  the  recog¬ 
nized  need  to  maintain  the  technological  ad¬ 
vantage  that  provides  the  decisive  e<%e  in 
any  future  conflict^ 

DOD  BUDGET 

Our  enemy,  the  basis  for  our  acquisition  proc¬ 
ess,  has  all  but  disappeared.  Wi^out  the  Joint 
Chiefs  of  Staff  validated  "threat"  to  provide 
the  basis  for  new  acquisitions,  the  DOD  in  the 
mid-to-late  1990s  will  be  vulnerable  to  the 
competing  needs  of  other  government  agen¬ 
cies.  Current  congressional  budget  debates 
vividly  reflect  the  denuse  of  the  Soviet  threat 
and,  as  expected,  IXDD  downsizing  is  viewed 
as  the  source  of  funding  for  new  social  initia¬ 
tives.  The  estimated  $259.1  billion  in  EXDD  fis¬ 
cal  year  (FY)  1993  budget  autiiority  is  31 
percent  below  FY  1985,  as  shown  in  Table  1, 
and  the  Secretary  of  Defense  has  projected  a 
FY  1994  budget  that  will  be  significantiy 
($12.9  billion)  lower  than  President  George 
Bush's  administration  requested.  In  FY  1993, 
the  DOD  budget  is  less  than  the  interest  pay¬ 
ments  on  the  federal  debt  and  by  1997,  de¬ 
fense  outlays  will  fall  below  three  and 
one-half  percent  of  the  Gross  National  Prod- 
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Table  1 

Declining  DOD  Budget  (Dollars  in  billions) 


Growth 

CurrerM 

Constant 

Real  Growth 

Year 

Dollars 

Dollars 

Percentage 

1985 

286.8 

375.6 

- 

1986 

281.4 

359.1 

-4.4 

1987 

279.5 

245.7 

-3.8 

1988 

283.8 

338.5 

-2.1 

1989 

290.8 

333.7 

-1.4 

1990* 

291.0 

423.1 

-2.9 

1991* 

276.0 

292.9 

-9.6 

1992* 

274.5 

284.7 

-2.8 

1993 

259.1 

259.1 

-9.0 

FY  1985-93  real  change; 

*Excludes  costs  of  Operations  DESERT  SHIELD/STORM. 

-31.0 

uct  (GNP)  and  become  the  lowest  since  before 
Pearl  Harbor.® 

The  DOD  is  attempting  to  link  its  outy'ear 
budgets  with  its  long-term  strategy.  The  over¬ 
all  goal  of  the  current  budget  plan  is  to  prop¬ 
erly  fund  the  new  regional  strategy  originally 
aimounced  by  President  Bush  and  sutv 
sequendy  adopted,  in  concept  at  least,  by  the 
Clinton  administration.  As  new  and  larger  de¬ 
mands  are  placed  on  the  Secretary  of  Defense 
to  give  up  even  more  funding  in  the  outyear 
budgets,  the  difficulties  associated  widi  ade¬ 
quately  funding  this  new  post-Cold  War  re¬ 
gional  strategy  wUl  continue  to  escalate. 
Figure  1  illustrates  the  downward  trend  we 
are  experiencing  and  most  discussions  on 
Capitol  HUl  are  not  about  regional  conflicts 
but  about  more  DOD  budget  reduction  and 
how  quickly  it  can  be  accoiiq7lished.  This  dis¬ 
cussion  is  not  meant  to  imply  "the  sky  is  fall¬ 
ing,"  only  that  the  nation  can  no  longer  adord 
to  buy  large  quantities  of  the  latest  and  great¬ 
est  protection  systems.  The  projected  FY 1994 
budget  of  $250.7  billion  is  still  a  significant 
commitment  by  the  nation  to  fund  the  DOD, 
but  achieving  an  adequate  level  of  security 


with  reduced  funds  will  require  a  new 
streamlined  infrastructure  and  a  new  ap¬ 
proach  to  the  acquisition  of  future  weapon 
systems. 

Because  the  threat  has  been  significantly  re¬ 
duced,  DOD  is  not  under  pressure  to  modern¬ 
ize  the  fighting  capabilities  of  its  forces 
rapidly.  Concurrency  in  development  pro¬ 
grams  will  be  reduced  dramatic^y  to  miti¬ 
gate  risk  and  cost  impacts,  and  equipment 
currently  in  the  field  will  be  retained  for 
much  longer  periods  of  time.  Faced  with  a 
considerably  smaller  budget  in  the  future  and 
with  the  potential  for  new  threats  to  emerge, 
DOD  has  implemented  a  new  and  revitalized 
Science  and  Technology  (S&T)  program  to: 

..develop  and  make  available  to  the  military 
forces  new,  advanced  and  affordable  techrwlo- 
gies  that  wUl  ensure  long-term  military  supe¬ 
riority.  ...This  strategy  will  seek  to  sustain  and 
apply  the  dramatic  advances  in  information 
technology,  involve  the  military  user  early  and 
continuously,  and  demonstrate  technology  as 
extensively  and  realistictdly  as  possible.* 
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Figure  1 .  Defense  Outlays  as  a  Share  of  GNP  (Source:  1992  Joint  Military  Agreement) 
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SQENCEAND 
TECHNOLOGY  PROGRAM 
The  Director  of  I>efense  Research  and  Engi¬ 
neering  (DDR&E)  is  responsible  for  the  Sci¬ 
ence  and  Technology  (S&T)  program  within 
the  DOD.  In  July  1992,  DDR&E  released  the 
first  comprehensive  post-Cold  War  S&T  strat¬ 
egy  to  provide  a  blueprint  for  technology  de¬ 
velopment  and  resource  allocation  in  the 
1990s.  The  strategy  stresses  the  importance  of 
feedbadc  from  the  watfighters  in  providing 
concepts,  doctrines  and  military  ne^s  to  the 
developers  of  technology  and  systems.  It  also 
stresses  the  "feed-forward"  of  new  technol¬ 
ogy  and  sratems  from  the  developers  to  the 
operators.® 

This  process  will  be  implemented  electroni¬ 
cally  and  will  involve  a  dramatically  ex¬ 
panded  and  integrated  set  of  instrurrvented 
training  ranges  and  electroruc  battlehelds. 
Networked  "syntiietic  envirorunents"  provide 


the  foundation  for  bringing  developers,  scien¬ 
tists,  engineers,  rrtanufacturers,  and  war¬ 
fighters  together  to  accomplish  the  goal  of 
"early,  intensive  and  continued  involvement 
of  warfighters."* 

A  second  key  facet  of  the  new  strategy  is  to 
revolutionize  military  operations  by  taking 
advantage  of  the  rapidly  expanding  capabili¬ 
ties  in  information  technology,  both  hardware 
and  software.  The  exponential  increase  in 
computer  performance  and  increasingly  more 
callable  computer  networks  have  fueled  this 
information  technology  explosion,  and  simi¬ 
lar  performance  trends  are  expected  to  con¬ 
tinue.  As  a  result,  enormous  opportunities 
exist  to  design  more  capable  and  affordable 
military  systems,  to  train  the  force  better  and 
to  create  more  effective  conunand,  control, 
corrununications  and  intelligence  (C^)  struc¬ 
tures.  Military  user  involvement  in  the  devel¬ 
opment  process  will  be  enhanced 
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dramatically  by  the  technology  revolution  as 
it  will  permit  using  more  realistic  and  interac¬ 
tive  simulations  and  exercises  to  evaluate 
emerging  technologies  without  expending 
substantial  resources.  Figure  2  shows  the 
process  envisioned  to  permit  maximum  in¬ 
volvement  of  the  warfighter.^ 

To  ensure  the  technology  is  ready,  manufac¬ 
turing  processes  ate  available,  and  operating 
concepts  are  understood  before  a  formal  ac¬ 
quisition  program  is  undertaken,  the  DDR&E 
will  sponsor  Advanced  Technology  Demon¬ 
strations  (ATD)  to  validate  specific  capabili¬ 
ties.  Technology  demonstrations  are  not  new 
to  the  acquisition  process.  What  is  new  is  the 
scope  and  depth  of  Qte  envisioned  ATDs  and 
the  central  position  diey  will  play  in  the  ac¬ 
quisition  process.  "These  demonstrations  of 
capability,  coupled  widi  advanced  simulation 
techniques,  will  lead  to  comprehensive  as¬ 
sessments  of  technical  feasibility,  affordability, 
and  operational  utility,"  according  to  DDR&£ 


S&T  strategy.®  In  simplistic  terms,  the  devel¬ 
oper  of  a  new  weapon  system  must  demon¬ 
strate  the  operational  benefits  or,  in  business 
terms,  the  "value  added"  of  his  concept  in  in¬ 
fluencing  the  outcome  of  the  battle.  The  "bat¬ 
tle"  in  this  case  will  be  conducted  on  an 
electronic  battlefield  controlled  by  the  DOD 
acquisition  coirununity  (developers,  testers, 
users,  etc)  Figure  3,  on  the  following  page, 
graphically  portrays  the  three  key  tenets  of 
the  S&T  strategy  and  their  interactions. 

PROVIDING  FOCUS  - 
SEVEN  S&T  THRUSTS 
To  ensure  the  S&T  program  is  properly  fo¬ 
cused  in  the  development  community,  seven 
"Thrusts"  have  been  established  by  the 
DDR&E.  emoting  from  ttie  S&T  Strategy: 

Seven  Thrusts  have  been  defined  to  rep¬ 
resent  the  demands  being  placed  on  the 
S&T  program  by  the  user's  most  press¬ 
ing  military  and  operational  require- 
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Figures.  The  New  S&T  Strategy 


merits.  While  there  are  goals  and  activi¬ 
ties  in  the  S&T  program  that  fall  out¬ 
side  of  these  Thrusts,  it  is  crucial  to  the 
success  of  the  S&T  program  that  invest¬ 
ments  be  focused  on  those  efforts  which 
show  the  greatest  promise  for  improv¬ 
ing  future  military  capabilities,  rather 
than  simply  providing  a  "balance" 
across  all  possible  options.  Focus,  not 
balance,  is  the  watchword  of  the  new 
S&T  strategy.^ 

The  following  paragraphs  briefly  describe  the 
seven  Thrusts  as  stated  in  the  S&T  strategy  re¬ 
port. 

Global  Surveillance  and  Communications. 
The  ability  to  project  power  requires  a  global 
surveillance  and  communications  capability 
that  can  focus  on  a  trouble  sprat,  siuge  in  ca¬ 
pacity  when  needed  and  resprand  to  Ae  needs 
of  the  commander. 

Precision  Strike.  The  desire  for  reduced  casu¬ 
alties,  economy  of  force  and  fewer  weaprans 


platforms  demands  that  we  locate  high-value, 
time-sensitive  fixed  and  mobile  targets  and 
destroy  them  with  a  high  degree  of  confi¬ 
dence  within  tactically  useful  timelines. 

Air  Superiority  and  Defense.  The  need  to  de¬ 
fend  deployed  military  forces,  and  help  de¬ 
fend  allies  and  coalition  partners,  from  the 
growing  threat  of  hi^  performance  aircraft 
and  ballistic  and  cruise  missiles,  and  the  need 
to  maintain  decisive  capabilities  in  air  com¬ 
bat,  interdiction  and  close  air  support,  require 
a  strong  effort  in  missile  defense  and  air  supe¬ 
riority. 

Sea  Control  and  Undersea  Superiority.  The 
ability  to  maintain  overseas  presence,  conduct 
forcible  entry  and  naval  interdiction  opera¬ 
tions  and  operate  in  littoral  zones,  while 
keeping  loses  to  a  minimum,  presupprases  a 
strong  capability  in  sea  control  and  undersea 
warfare. 

Advanced  Land  Combat  The  ability  to  rap>- 
idly  deploy  our  ground  forces  to  a  region,  ex- 
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Figure  4.  The  New  S&T  Strategy:  the  Seven  S&T  Thrusts 


ercise  a  high  degree  of  tactical  mobility  and 
overwhelm  the  enemy  quickly  and  with  mini¬ 
mal  casualties  in  the  presence  of  a  heavy  ar¬ 
mored  threat  and  smart  weaponry  requires 
highly  capable  land  combat  systems. 

Synthetic  Envirorunents.  A  broad  range  of  in¬ 
formation  and  human  interaction  technolo¬ 
gies  must  be  developed  to  synthesize  present 
and  future  battlefields.  We  must,  therefore, 
synthesize  factory-to-batflefield  environments 
with  a  mix  of  red  and  simulated  objects  and 
make  them  accessible  from  widely  dispersed 
locations.  Integrated  teams  of  users,  develop¬ 
ers,  and/or  testers  will  be  able  to  interact  ef¬ 
fectively.  Synthetic  environments  will  prepare 
our  leaders  and  forces  for  war  and  will  go 
with  them  to  the  real  battlefield. 

Technology  for  Affordability.  Technologies 
that  reduce  unit  and  life  cycle  costs  are  essen¬ 
tial  to  achieving  significant  performance  and 
affordability  improvements.  Manufacturing 
process  and  product  performance  issues  are 
integral  parts  of  the  program.  Advances  are 


particulariy  needed  in  technologies  to  sup¬ 
port  integrated  product  and  process  design, 
flexible  manufacturing  systems  that  decouple 
cost  from  volume,  enterprise-wide  informa¬ 
tion  systems  that  improve  program  control 
and  reduce  overhead  costs,  and  integrated 
software  engineering  environments. 

Figure  4  shows  the  relationship  of  the  Thrusts 
to  the  overall  E)OD  acquisition  environment. 
Inherent  in  this  illustration  of  the  seven 
Thrusts  in  the  S&T  strategy  is  the  concept  of 
utilizing  emerging  technology  (Synthetic  En¬ 
vironments  and  Technology  for  Affordability) 
to  enhance  the  ability  of  the  other  five  Thrusts 
to  achieve  their  goals.  As  illustrated,  "In¬ 
volvement  of  Warfighters"  is  facilitated  by  us¬ 
ing  "Virtual  Prototypes"  in  a  "Synthetic 
Environment."  The  virtual  prototype  enables 
the  user  to  better  define  his  system  recjuire- 
ments  in  the  accpiisition  evolution,  and  it  pro¬ 
vides  a  means  for  "value  added"  assessments 
by  DOD  decision  makers.  A  similar  iterative 
chart  could  be  drawn  depicting  the  use  of  vir¬ 
tual  prototypes  in  the  engineering  design 
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process  within  a  specific  conunercial  com¬ 
pany.  "Virtual  Prototype,"  unfortunately,  does 
not  have  a  universally  accepted  definition 
and  may  mean  significantly  different  things 
to  different  people.  For  some  people,  it  may 
be  a  simple  computer  representation  of  a  part, 
subsystem  or  end  product  For  others,  a  com¬ 
puter-generated  prototype  must  include  the 
ability  of  the  operator  to  be  "immersed"  as 
well  as  navigate  within  the  model  before  it  is 
considered  a  "virtual"  prototype.  For  the  pur¬ 
pose  of  this  paper,  a  virtual  prototy]7e  is  de¬ 
fined  as  a  computer-based  simulation  of  a 
system  or  subsystem  with  a  degree  of  func¬ 
tional  realism  that  is  comparable  to  that  of  a 
physical  prototype.  This  definition  is  in  use 
by  the  D^ense  Modeling  and  Simulation  Of¬ 
fice. 

DEFENSE  MODEUNG  AND 
SIMULATION  OFFICE  (DMSO) 

In  1991,  Congress  directed  the  DOD  to  estab¬ 
lish  an  office  to  coordinate  a  Department¬ 
wide  approach  to  simulation  and  training. 
Mr.  Don^d  J.  Atwood,  Jr.,  Deputy  Secretary  of 
Defense,  responded  by  undertaking  "a  new 
initiative  to  promote  the  effective  and  efficient 
use  of  modeling  and  simulation  (M&S)  in 
joint  education  and  training,  research  and  de¬ 
velopment,  test  and  evaluation,  and  opera¬ 
tions  and  cost  analysis."*®  The  DOD  Modeling 
and  Simulation  Management  Plan  calls  for  a 
DOD  Executive  Coimdl  for  Models  and 
Simulations  (EXCIMS)  to  advise  the  Under 
Secretary  of  Defense  (Acquisition)  (USD(A)) 
on  M&S  policy,  initiatives,  standards  <md  in¬ 
vestments.  The  DMSO  serves  as  the  executive 
secretary  to  the  EXQMS.** 

A  draft  DOD  Directive  5(XX).GG,  currently  in 
staffing,  is  expected  to  formally  establish  pol¬ 
icy  and  assign  roles  and  responsibilities  for 
DOD  M&S  management.  Figiue  5  shows 
how  the  management  structure  might  be  de¬ 
fined.  The  EXQ\K  membership,  composed 
of  general  and  flag  officers  and  c'^liarts  of 


equivalent  rank,  is  anticipated  to  include  the 
following  organizations:’^ 

—  Deputy  Ehrector,  Defeirse  Research  and  En¬ 
gineering  (DDDR&E) 

—  Assistant  Secretary  of  Defense  for  Com¬ 
mand,  Control,  Conununications  and  Intel¬ 
ligence  (ASDfCTI)) 

—  Assistant  Secretary  of  Defense  for  Force 
Management  and  Personnel  (ASD(FM&P)) 

—  Assistant  Secretary  of  Defense  for  Program 
Analysis  and  Evaluation  (ASD(PA&E)) 

—  Assistant  Secretary  of  Defense  for  Produc¬ 
tion  and  Logistics  (ASD(P&L)) 

— Chairman,  Joint  Chiefs  of  Staff  (QCS) 

—  Army 

—  Navy 

—  Air  Force 

—  Marine  Corps. 

The  DMSO  was  created  to  enhance  readiness 
by  making  better  use  of  limited  M&S  re¬ 
sources,  to  identify  the  organizations  respon¬ 
sible  for  specific  M&S  activities  and  to 
develop  a  strategy  to  improve  DOD  capabili¬ 
ties  through  M&S.  The  DMSO  has  been 
tasked  to  establish  a  DOD-wide  structure  to 
coordinate  joint  M&S  activities,  develop  an 
M&S  master  plan  and  furnish  guidance  for 
Component  M&S  plans,  and  focus  on  interop¬ 
erability  and  standards  by  developing  com¬ 
mon  tools  and  methods.  The  scope  of  the 
DMSO  responsibilities,  as  outlined  in  the 
M&S  Management  Plan,  includes: 

—  Promulgating  policies  at  the  direction  of 
the  USEH  A)  that  facilitate  the  application  of 
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Figure  5.  DOD  Modelii^  and  Simulation  Management  Structure 


M&5  among  joint  education  and  training, 
research  and  development,  test  and  evalu¬ 
ation,  and  operations  and  cost  analysis  dis¬ 
ciplines. 

—  Distributing  USD(A)  approved  guidelines 
to  assist  in  Component  development  of 
consistent  M&S  plans  in  conhguration 
management,  verification,  validation,  ac¬ 
creditation  and  releasability. 

—  Developing  USD(A)  approved  liaison  proc¬ 
ess  to  coordinate  and  assist  in  the  develop¬ 
ment,  acquisition  and  sharing  of 
technology,  standards,  verification,  valida¬ 
tion  and  accreditation  processes  among 
DOD  Components  and  the  defense  indus¬ 
try. 

—  Developing  USD(  A)  approved  mechanisms 
to  foster  cooperation  among  DOD  Compo¬ 
nents  to  maximize  M&S  interoperability 


while  eliminating  duplicative  development 
of  M&S  advanced  technologies. 

—  Advising  the  USD(A)  on  matters  relating 
to  improving  the  use  of  M&S  that  supports 
input  to  the  Joint  Requirements  Oversight 
Council  (JROC),  the  Defense  Plaiming  and 
Resources  Board  (DPRB)  and  the  Defense 
Acquisition  Board  (DAB). 


SIMULATION,  TRAINING  AND 
INSTRUMENTATION  COMMAND 
(STRICOM) 

On  1  August  1992,  STRICOM  was  established 
by  the  Army  as  a  major  subordinate  com¬ 
mand  of  the  Army  Materiel  Cotiunand 
(AMC).  The  STRICOM  mission  is  to  provide 
training  and  test  simulation,  simulator,  target 
and  instrumentation  products  and  services  to: 

—  Develop  and  sustain  warfi^ting  skills 
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—  Create  a  syndietic  environment  to  evaluate 
concepts  and  support  requirements  defini¬ 
tion 

—  Support  materiel  development  and  test 
and  evaluation. 

Organized  as  shown  in  Figure  6,  STRICOM 
manages  more  than  200  projects  to  coordinate 
and  advance  distributed  interactive  simula¬ 
tion  (DIS)  architectures  and  standards  with 
the  oversight  of  the  DMSO  through  a  Memo¬ 


randum  of  Agreement  dated  16  September 
1992.  The  STRICOM  provides  DIS  technical 
management  for  the  Army  and  is  responsible 
for  developing  the  Battieheld  Distribution 
Simulation-Development  (BDS-D),  the  follow- 
on  to  the  Simulation  Network  (SIMNET).  The 
STRICOM  develops  DIS  standards  and  main- 
tarns  configuration  marragement  of  DIS  archi¬ 
tecture.  As  manager  of  the  Combined  Arms 
Assessment  Network,  STRICOM  maintains 
sites  at  Fort  Knox,  Kyi,  and  Fort  Rucker,  Ala. 
Army  guidance  on  the  functional  require- 
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Figure  6.  Simulation,  Training  and  Instrumentation  Command  (STRICOM) 
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Army’s  Science  and  Technology  Program  Distributed  Interactive 
Simulation  (DiS)  Functional  Requirements  Ust 
(as  of  20  November  1992) 

The  priority  order  is  as  follows: 

1 .  Advanced  Precision  Strike  Top  Level  Demonstration 

2.  Common  Ground  Station  Advanced  Technology  Demonstration 

3.  RFPI  Top  Level  Demonstration 

4.  LOSAT  Technology  Demonstration 

5.  Stingray  Technology  Demonstration 

6.  Rotorcraft  Pilot’s  Associate  Advanced  Technology  Demonstration 
7  CAC2/Combat  ID  Advanced  Technology  Demonstration 

8.  Advanced  Vehicles  Technologies  Top  Level  Demonstration 

9.  Tractor  Hip  Technology  Demonstration 

10.  TACAWS  Technology  Demonstration 

11 .  Armor  Antiarmor  Advanced  Technology  Demonstration 

12.  Generation  11  Advanced  Technology  Demonstration 

13.  STRATA  Demos 

14.  Electric  Gun  Virtual  Prototype  Technology  Demonstration 

15.  Virtual  Factory  Advanced  Concept  Evaluation 

16.  Logistics  Distributions-Transportation  Network 

17.  Advanced  Cargo  Aircraft  Advanced  Concept  Evaluation 

18.  Future  Attack  Air  Vehicle  Advanced  Concept  Evaluation 

19.  Biological  Agent  Detection  Technology  Demonstration 

20.  Flame  and  Incendiary  Munitions  Technology  Demonstration 

Figure  7.  Army  Guidance  on  DIS  Network  Requirements 


quirements  for  the  DIS  network  is  repre¬ 
sented  by  tiie  20  items  shown  in  Figure  7.'^ 

The  Project  Manager  for  Training  Devices 
(PM  TRADE)  is  dedicated  to  supporting  the 
Army  Combat  Training  Centers  by  providing 
tTciining  devices  and  simulator  to  enhance 


the  ability  of  soldiers,  leaders  and  units  to 
perform  ttieir  mission. 

The  Project  Manager  for  Combined  Arms  Tac¬ 
tical  Trainer  (PM  CATT)  manages  the  devel¬ 
op  lent  of  the  Close  Combat  Tactical  Trainer 
(CCTT),  a  networic  of  manned  simulators  pro- 
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viding  combined  arms  and  collective  training 
using  force-on-force  free-play  simulation  on  a 
virtual  electronic  battlefield.  The  manned 
simulators  will  include  the  Ml-series  tank, 
^^2/M3  Bradley,  FIST-V  vehicles  and  dis¬ 
mounted  infantry.  Fixed  and  mobile  CCTT 
systems  are  planned. 

The  Project  Manager  for  Instrumentation,  Tar¬ 
gets  and  Threat  Simulators  (PM  ITTS)  man¬ 
ages  the  research,  development,  design. 


acquisition,  fielding,  modihcations  and  capa¬ 
bility  accounting  of  major  instrumentation, 
taigets  and  threat  simulators  required  for 
Army  technical  and  operational  test  and 
evaluation. 

The  Project  Office  for  Combined  Arms  As¬ 
sessment  Network  (PO  CAAN)  is  responsible 
for  the  operation  and  maintenance  of  the 
CAAN  and  instrumented  ranges. 
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That  is  the  biggest  foot  thing  we  have  ever  done.... 
The  [atomic]  bomb  will  never  go  off,  and  I  speak 
as  an  expert  in  explosives. 

—  ADM  William  Leahy,  USN 
to  President  Truman,  1945 


Chapter  3 

SPECTRUM  OF  SYNTHETIC 
ENVIRONMENTS 


The  purpose  of  this  chapter  is  to  identify 
and  describe  the  worid  of  synthetic  en¬ 
vironments.  This  environment  is  de¬ 
fined  as: 

Interconnected  simulations  that  repre¬ 
sent  activities  with  a  high  level  of  real¬ 
ism  ranging  from  simulations  of 
theaters  of  war  to  factories  and  manu¬ 
facturing  processes.  They  are  created  by 
a  confederation  of  computers,  connected 
by  local  and  wide  area  networks  and 
augmented  by  super-realistic  special  ef¬ 
fects  and  accurate  behavioral  models. 
They  allow  complete  visualization  of 
and  total  immersion  into  the  environ¬ 
ment  being  simulated.  They  represent 
the  "real  world"  precisely.^ 

In  this  chapter,  the  discussion  of  synthetic  en¬ 
vironments  is  divided  into  four  sections.  The 
first  on  design  tools  includes  the  use  of  com¬ 
puters  to  design  and  manufacture  systems 
and  subsystems  encompassing  computer- 
aided  design  and  manufacturing,  stereoli¬ 
thography  and  virtual  prototypes.  In  the 
second  section,  we  discuss  virtual  reality.  The 
third  section  explains  simulation.  The  chapter 
ends  with  an  assessment  of  the  enabling  tech¬ 


nologies  which  make  synthetic  environments 
and  virtual  prototyping  possible. 

COMPUTER-AIDED  DESIGN  AND 
COMPUTER-AIDED  MANUFACTURING 
(CAD/CAM) 

The  avaUability  of  reasonably  priced,  highly 
capable  computers  and  design  software  has 
changed  radically  the  design  process  and  its 
relationship  with  manufacturing.  Using  vari¬ 
ous  software  packages,  design  engineers  can 
create  a  set  of  detailed  drawings  for  each  part 
used  in  the  design,  perform  stress  analysis  on 
the  design  through  simulation,  and  ultimately 
convert  the  data  files  into  detailed  engineer¬ 
ing  drawings  and  visualizations.  Designs  can 
be  produced  not  only  in  a  fraction  of  the  time 
required  using  manual  tools,  but  they  match 
precisely  the  strength  of  the  structure  with  the 
anticipated  operating  loads  and  incorporate 
manriJFacturing  constraints  yielding  a  product 
that  is  designed  to  match,  in  detail,  the  re¬ 
quirement  with  what  can  be  manufactured 
readily . 

There  has  been  tremendous  growth  in  the 
market  for  CAD/CAM  hardware  and  soft¬ 
ware.  Total  sales  have  grown  from  $3  billion 
in  1985  to  $12  billion  in  1992;  however,  the 
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CAD/CAM  Market  by  End  User  Industry 
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rate  of  growth  has  slowed  during  this  period 
from  27  jjercent  per  year  in  1985  to  17  percent 
per  year  in  1992.  Figure  8  shows  the  growth 
that  has  taken  place  in  the  electronics  and 
construction  sectors  at  the  expense  of  aero¬ 
space,  automotive  and  electrical  machinery 
sectors  from  1985  to  1992.2 

Computer-aided  design  is  best  dehned  as  a 
process  that  uses  computers  to  assist  in  creat¬ 
ing,  modifying,  analyzing  or  optimizing  a  de¬ 
sign.^  The  CAD  tool  is  a  combination  of 
hardware  and  software  that  enhances  an  engi¬ 
neer's  performance.  In  the  hands  of  a  quali¬ 
fied  design  engineer,  it  is  a  tremendous  asset, 
capable  of  greatly  accelerating  design  and 
yielding  more  robust  designs  incorporating 
detailed  consideration  of  Ure  manufacturing 
process  and  capabilities,  all  at  a  lower  cost. 
The  principal  design-related  tasks  performed 
by  a  CAD  system  may  be  grouped  into  three 
categories  as  follows. 


Modeling 

The  CAD  tool  is  used  to  construct  graphic  im¬ 
ages  of  an  object  using  basic  geometric  enti¬ 
ties  such  as  points,  lines  and  circles.^  The 
designer  can  manipulate  the  images  by  seal 
ing,  transforming  and  rotating.  With  this  com¬ 
puter-based  flexibility,  the  designer  can 
experiment  with  various  design  alternatives. 
There  are  2-D  "surface"  and  3-D  "solid"  mod¬ 
els;  the  latter  contain  a  full  description  in 
mathematical  terms  of  the  volume  of  the  ob¬ 
ject.  Presently,  solid  modeling  is  considerably 
more  expensive  than  surface  modeling,  but  it 
allows  the  user  to  analyze  mass  properties,  in¬ 
terferences  and  fit  Color  Plate  1,  Advanced 
Computer-Aided  Design  (ACAD),  courtesy  of 
Lockheed,  Fort  Wortii  Company,  contains  ex¬ 
amples  of  modeling  capabilities  which  in¬ 
clude:  wire  framing,  surfaces,  solids,  analysis, 
visualization  and  associativity.  Each  of  these 
functions  is  described  in  Figure  9.  These 
plates  were  generated  by  IBM's  Computer- 
Aided  Three  Dimensional  Interactive  Appli- 
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Figure  9.  Modeling  (Source:  Lockheed,  Fort  Worth  Company) 


cations  (CATIA)  software  package,  a  series  of 
application  programs  that  forms  a  highly  inte¬ 
grated  design,  analysis  and  manufacturing 
system.® 

Data  visualization  is  the  technique  of  display¬ 
ing  data  using  colors  and/ or  shapes  to  repre¬ 
sent  numerical  vedues.  The  values  of  the  data 
can  be  magnified  to  give  the  appearance  of 
greater  variations,  allowing  the  engineer  to 
detect  significant  aspects.  While  the  data  may 
be  visualized  in  abstract  forms,  it  is  usually 
more  useful  to  drape  the  data  over  the  CAD 
model  of  a  component  to  relate  model  output 
to  physical  locations.  For  example,  heat  gradi¬ 
ents  displayed  on  a  component  allow  the  en¬ 
gineer  to  understand  the  process  of  heat 
transfer  and  identify  critical  spots.  Also,  by 
constructing  a  series  of  visual  displays  and 
playing  them  in  sequence,  the  data  can  be  ani¬ 
mated  to  reveal  more  detail  about  the  process 
being  modeled.  Thus,  heat  flows  or  vibrations 
can  appear  to  move,  allowing  the  engineer  a 
new  perspective  in  understanding  the  data. 
Data  visualization  is  akin  to  simulation  since 


simulation  can  be  defined  as  implementing  a 
model  over  time. 

The  CATIA  provides  visualization  and  is  be¬ 
ing  used  by  Boeing  in  the  design  of  the  F-22 
and  the  777  aircraft.  They  are  employing  sur¬ 
face  modeling  on  the  F-22  and  solid  modeling 
on  the  777  aircraft.  The  CATIA  family  of  pro¬ 
grams  is  typical  of  the  design  packages  avail¬ 
able  today.  It  allows  the  user  to  create 
conceptual  designs  quickly,  view  the  designs, 
and  perform  analysis.  The  common  database 
can  be  used  concurrently  by  all  users.  See  Fig¬ 
ure  10,  on  the  following  page.  This  provides  a 
unique  flexibility  allowing  designers  of  differ¬ 
ent  parts  of  an  assembly  to  use  different  tools, 
while  maintaining  a  common  database. 

Another  example  of  the  capabilities  of  today's 
design  software  packages  is  Parametric's 
Pro/Engineer  software  package.  It  is  para¬ 
metric,  meaning  the  user  must  define  general 
features  and  relationships  of  a  part  or  assem¬ 
bly  and  the  system  develops  solid  models. 
When  the  user  changes  a  dimension,  the  part 
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IBM’S  CATIA  Software 
Product  Development 


Figure  10.  CATIA's  Common  Database  (Source:  IBM) 


changes  shape  automatically.  Pro/Engineer  is 
feature-based  also,  meaning  all  mechanical 
parts  can  be  defined  by  featiues  such  as  slots, 
holes,  chamfers,  etc.  For  example,  sketch  a 
telephone  and  the  tool  automatically  inter¬ 
prets  the  sketch  and  displays  a  fully-dimen¬ 
sioned  object*  Typical  of  the  design  software 
packages  available  today,  the  package  ad¬ 
dresses  the  entire  development  process  from 
design  to  manufacturing. 

Meshing 

Engineering  models  are  mathematical  repre¬ 
sentations  of  real  world  conditions  whose 
piupose  is  to  solve  engineering  design  ques¬ 
tions.  These  models  focus  on  specific  prob¬ 
lems  such  as  flight  dynamics,  heat  transfer, 
mechanical  stress,  vibration  and  electromag¬ 
netic  effects.  Since  fiiey  are  often  constructed 
for  imique  circumstances,  integration  into 
larger  models  or  simulations  is  difficult  Engi¬ 


neering  models  are  usually  closed  form  with 
no  hiunan  interaction  possible;  they  run  "off 
line"  in  batch  mode.  The  output  is  in  tabular 
printouts  and  interpreted  by  charts  and 
graphs. 

Finite  element  analysis  (FEA)  is  one  class  of 
advanced  engineering  modeling.  Rather  than 
applying  a  complicated  (and  often  intracta¬ 
ble)  maftematical  model  at  the  macro  level  to 
a  component,  the  component  is  conceptually 
divid^  into  many  small  finite  elements 
through  "meshing."  Each  element  can  then  be 
easily  modeled  and  solved  individually.  The 
component  performance  is  the  sum  of  the  re¬ 
sponse  of  each  finite  element  Automated 
tools  are  available  which  can  input  either  2-D 
or  3-D  CAD  drawings  of  components  and  di¬ 
vide  them  into  finite  elements.  Once  subdi¬ 
vided,  models  for  the  effects  being 
investigated  n\ay  be  applied. 
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Figure  11.  Meshing  (Source:  Lockheed,  Fort  Worth  Company) 


Mesh  generation  forms  the  backbone  of  finite 
element  analysis.  Meshing  refers  to  the  gen¬ 
eration  of  nodal  coordinates  and  elements 
and  includes  the  automatic  numbering  of 
nodes  and  elements  based  on  a  minimal 
amount  of  user-supplied  data.  Automatic 
mesh  generation  reduces  errors  and  saves 
much  user  time,  thereby  reducing  FEA  costs.^ 
Color  Plate  2,  page  124,  contains  examples  of 
meshing  capabilities  including  structural 
modeling,  triangle  meshing,  quad  meshing, 
edge  meshing  and  finite  difference-time  do¬ 
main  (FD-TD)  meshing,  which  are  described 
in  Figure  11. 

Engineering  Analysis 

Designers  can  use  software  to  perform  an  en¬ 
gineering  analysb,  such  as  dyruunic  simula¬ 
tion  and  FEA.*  Color  Plate  3,  page  125,  also 
courtesy  of  Lockheed  denwirstiates  the  kincb 
of  analyses  performed  by  Advanced  Com¬ 
puter-Aided  Design  (ACAD)  tools.  These 


functions  are  described  at  Figure  12,  on  the 
following  page.  The  FEA  enables  designers  to 
evaluate  complex  structures  cpiickly  and  ac¬ 
curately.  Most  CAD  systems  can  perform 
analyses  of  properties  such  as  surface  areas, 
weights,  volumes,  centers  of  gravity  and  mo¬ 
ments  of  inertia.  These  tcx)ls  can  be  used  on 
parts,  sections  or  entire  systems.  At  the 
McDormell  Douglas  Long  Beach  facility,  de¬ 
sign  engineers  used  Automatic  D3mamic 
Analysis  of  Mechanical  Systems  (ADAMS) 
software  to  analyze  die  load  required  on  an 
actuator  arm  they  were  evaluating  to  deter- 
nune  its  performance  as  a  closure  device  on  a 
cargo  door  of  the  MD-11  aircraft.  The  model 
allowed  the  user  to  specify  material  proper¬ 
ties  and  perform  simulation  under  various 
flight  conditions  to  determine  if  the  closure 
device  would  work  properly. 

The  CAM  is  the  technique  of  using  computers 
and  software  to  aid  in  assessing  manufactur- 
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Figure  12.  Engineering  Analysis  (Source:  Lockheed  Company) 


ing  capabilities  and  to  plan  (or  nunufacturing 
induding  processes,  tooling  and  material 
handling.  An  integrated  CAD /CAM  system 
provides  for  die  exchange  of  information  be¬ 
tween  design  and  manufacturing  functions. 
The  CAM  tools  evaluate  the  feasibility  of  pro¬ 
ducing  the  designed  product  economiodly, 
considering  quality  control,  tooling  fabrica¬ 
tion  and  assonbly.  In  this  manner,  the  com¬ 
puter  allows  designers  and  manufacturing 
personnel  to  coordinate  the  design  to  ensure 
the  item  can  be  produced.  Additionally,  since 
CAM  has  become  the  virtual  standard  for 
high  accuracy  machining  in  the  United  States, 
numerical  control  (NC)  data  can  be  drawn  di- 
rectiy  from  CAM  data  files.'” 

The  ability  to  incorporate  manufacturing  con¬ 
siderations  in  the  design  process  and  then 
translate  CAM  data  into  NC  instructions  has 
been  a  key  element  in  industry's  adaption  of 


CAD  programs.  Industry  has  embraced 
CAD/CZAM  due  to  its  payback  derived  from 
lower  manufacturing  costs  resulting  from 
fewer  design  changes,  parts  fitting  together 
the  first  time  and  designs  being  producible. 
Due  to  the  ease  in  sharing  data,  design  and 
manufacturing,  engineers  can  assess  the  feasi¬ 
bility  of  manufacturing  an  item  and  then 
modify  the  design  or  the  manufacturing  proc¬ 
esses  to  produce  it.  Good  examples  of  the  re¬ 
lationship  between  design  and  manufacturing 
were  seen  during  our  visits  to  the  Boeing 
Company  and  the  Kohler  Corporation  where 
the  advantages  of  CAD/ CAM  tools  were 
demonstrated  at  both  ends  of  the  manufactur¬ 
ing  spectrum,  from  the  sophisticated  777  air¬ 
craft  to  18-20  horsepower  engines.  In  both 
cases  their  design  tools  have  provided  a  clear 
competitive  advantage  in  their  respective 
markets.  These  applications  are  discussed  in 
Chapter  4. 
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As  illustrated  during  our  visits,  CAD/CAM 
tools  are  a  significant  source  of  competitive 
advantage  to  design  and  manufacturing  com- 
p>anies.  After  Parametric  Tedinology  Corpora¬ 
tion  aimounced  plans  to  open  a  sales  office  in 
Japan  last  year,  the  software  maker  received 
an  unusual  letter  from  an  engineer  at  a  large 
US.  manufacturer,  “I  caimot  overcome  the 
sense  of  foreboding.,  .putting  such  a  powerful 
tool  in  the  hands  of  historically  strong  and 
successful  competitors,"  he  wrote,  calling  it  a 
weapon  the  Japanese  can  use  "to  make  our 
life  hell."  The  article  went  on  to  quote  Mr. 
Stacy  Wolf,  a  product  developer  at  Rubber¬ 
maid  Inc.,  'TDesigns  that  might  have  taken  a 
month  can  often  be  done  in  a  matter  of 
hours."”  Mr.  Darryl  Miller,  an  engineer  at 
Eastman  Kodak  Co.,  says  his  team  has  cut  the 
time  it  takes  to  design  new  parts  by  50  per¬ 
cent.  Other  CAD/CAM  vendors  include 
Autodesk,  Structural  Dynamics  Research,  In¬ 
ternational  Business  Machines  and  Com- 
putervision. 

The  benefits  of  CAD/CAM  tools  depend  on 
the  qualifications  of  the  users  and  on  manage¬ 
ment's  effectiveness  in  program  implementa¬ 
tion.  According  to  Mr.  Peter  W.  Chevalier,  OIR 
Europe,  in  an  article  written  10  years  ago,  the 
savings  which  can  be  achieved  are  as  shown 
in  Table  2 


Based  on  these  averages  and  considering  the 
total  cost  of  the  system  including  hardware. 


Table  2. 

Savings  Using  CAD/CAM  Tools 

ACTIVITY 

SAVINGS 

Setup  Time 

20  -  60% 

Planned  Labor 

15-25% 

Tooling 

15-25% 

Rework  and  Scrap 

15-75% 

W.I.R  Carrying  Costs 

20-50% 

software  and  p>eisonnel,  it  is  reasonable,  ac¬ 
cording  to  Mr.  Chevalier,  to  expect  a  return  on 
investment  in  one  or  two  years.'^  Future  sav¬ 
ings  can  far  exceed  a  company's  investment. 
Boeing  plans  to  achieve  these  savings  on  their 
777  and  F-22  programs.  Kohler  has  achieved 
these  results  on  their  small-engine  line. 
Growth  in  this  area  is  powered  by  these  sav¬ 
ings  and  the  competitive  pressure  for  better 
products  in  less  time.  Today's  CAD/CAM 
tools  offer  reduced  design  and  manufacturing 
costs,  shorter  cycle  times,  better  and  custom¬ 
ized  designs  -  not  without  risks,  however. 

Risks 

Professor  Eugene  S.  Ferguson's  book.  Engi¬ 
neering  and  the  Mind's  Eye,  takes  a  probing 
look  at  the  process  of  engineering  design;  ar¬ 
guing  that,  despite  modem  advances,  engi¬ 
neering  is  still  as  much  intuition  and 
nonverbal  thinking  as  equations  and  compu¬ 
tation.’^  The  section  of  his  book  dealing  with 
"Design  Failures  and  Other  Surprises"  is  con¬ 
tained  at  Appendix  F. 

He  concludes  that  engineers  need  to  be  re¬ 
minded  continually  that  nearly  all  engineer¬ 
ing  failures  result  from  faulty  judgments,  not 
from  faulty  calculations.  Today's  designers 
have  no  way  of  knowing  the  critical  assump¬ 
tions  contained  in  today's  commercially-avail- 
able  analytical  programs.  Consequentiy,  the 
designer  must  either  accept  on  faith  the  pro¬ 
gram  results  or  check  them  sufficiently  to  be 
satisfied  the  programmer  did  not  make  dan- 
geroirs  assumptions  or  omit  critical  factors 
and  the  programmer  reflects  fully  the  subtie- 
ties  of  the  designer's  unique  problems.  This 
caution  applies  equally  to  computer-based 
simulations.'^ 

Challenges 

Two  major  technical  challenges  are  associated 
with  CAD/CAM  tools  that  have  a  bearing  on 
weapon  system  design.  The  first  relates  to 
visualization  and  the  second  to  data  ex- 
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change.  In  visualization,  the  problem  is  dis¬ 
playing  3-D  objects  and  scenes  on  2-D  scenes. 
The  most  common  solution  to  this  is  "magic 
carpet"  or  "fly  through"  capabilities  where 
the  user  can  travel  through  an  object  with  his 
cursor,  changing  direction  and  speed  to  view 
the  object  from  different  angles.  Thou^  a 
cumbersome  process,  designers  almost  uni¬ 
versally  were  comfortable  with  fliis  tech¬ 
nique.  Other  visualization  alternatives 
include  high-fidelity  simulators,  3-D  glasses, 
and  head  mounted  displays  (HMDs),  none  of 
which  is  embraced  by  designers  due  to  a  cont- 
bination  of  factors  including  cost,  capability, 
fidelity  and  utility. 

The  second  major  challenge  facing  designers 
is  the  maze  of  CAD,  CAM  and  Computer  In¬ 
tegrated  Manufacturing  (CIM)  systems  in 
place  that  designers  must  navigate  through  to 
bring  a  product  to  market.  While  specialized 
tools  and  databases  abound,  the  cormections 
among  them  are  ad  hoc.  In  design  environ¬ 
ments,  computational  tools  do  not  usually  in¬ 
teract  widi  respect  to  a  shared  model; 
designers  do;  tools  don't.  The  challenge  is  to 
move  toward  an  environment  where  design 
tools  interact  through  a  shared,  explicit  model 
of  the  design. 

This  area  is  being  investigated  by  The  Palo 
Alto  Collaborative  Testbed  (PAC'D,  a  labora¬ 
tory  for  joint  expreriments  in  computer-aided 
concurrent  engineering.  It  comprises  research 
groups  from  Stanford,  Lockheed,  Hewlett- 
Packard  cmd  Enterprise  Integration  Technolo¬ 
gies.  The  PACT  studies  have  identified  two 
key  issues  from  a  designer's  perspective: 

— How  to  bridge  the  multitude  of  models  to 
support  a  complex  design  at  various  sta^ 
of  the  design  process 

— How  to  manage  the  flood  of  information 
associated  with  a  design  so  everyone  stays 
mformed  but  no  one  drowns. 


Difliculties  associated  with  supporting  large- 
scale  distributed  engineering  systems  are  es- 
p>ecially  evident  in  ^e  design  of  systems  that 
combine  mechanical,  electrical  and  software 
components.  Initially,  researchers  thought  the 
intero{>eration  of  tools  across  heterogeneous 
platforms  would  be  a  significant  problem. 
This  turned  out  to  be  a  relatively  easy  task. 
The  harder  and  more  fundamental  task  facing 
researchers  was  agreeing  on  concepts  and  ter¬ 
minologies  that  could  be  shared  by  the  vari¬ 
ous  disciplines.  For  example,  users  must 
bridge  differences  in  abstractiorrs  and  views, 
such  as  position  and  time,  shape,  behavior, 
sensors  and  motors,  what  they  mean  and  how 
they  are  representeci'®  Successful  design  of 
systems  requires  an  intimate  understanding 
of  interactions  among  different  disciplines 
and  subsystems  so  cross-disciplinary  trade¬ 
offs  can  be  made.  Developing  such  an  under¬ 
standing  is  one  of  the  major  goals  of 
concurrent  engineering. 

STEREOLITHOGRAPHY 
Stereolithography  and  material  deposition 
techniques  are  two  principal  processes  used 
to  produce  rapid  prototypes.  Stereolithogra¬ 
phy  apparatus  (SLA)  equipment  was  first 
marketed  in  1988.  Using  lasers  and  a  spodal 
light-sensitive  liquid  plastic,  designs  are 
transformed  into  plastic  prototyp)es,  dimen¬ 
sionally-scaled  models  or  limited-run  produc¬ 
tion  samples,  often  in  a  matter  of  hours. 
Prototypes  can  be  produced  horn  any  of  the 
more  than  fifty  3-D  CAD  solid  and  surface 
data  sets  and,  if  necessary,  by  reverse  engi¬ 
neering  existing  parts.  Current  systems  can 
produce  parts  up  to  20  x  20  x  24  inches,  and 
multiple  parts  can  be  produced  and  joined  to¬ 
gether  to  produce  larger  pieces  with  a  high 
degree  of  accuracy  (+/-  25  Mil).’*  The  3-D 
Systems,  Inc.,  has  produced  and  installed  ap¬ 
proximately  300  machines  worldwide  —  200 
in  the  United  States.  At  least  eight  companies 
offer  these  systems.  Conceptually,  the  market 
can  be  split  roughly  into  two  major  ap- 
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Figure  13.  Green  Bank  Telescope 

proaches.  In  most  widespread  use  is  the  pho¬ 
topolymer-based  system,  a  chemical  process 
in  which  liquid  resin  converts  to  a  solid  poly¬ 
mer  after  exposure  to  ultraviolet  radiation  or 
a  visible  light  source.  A  second  front  com¬ 
prises  systems  using  various  material  deposi¬ 
tion  techniques  to  fabricate  parts.  These  tools 
facilitate  rapid  prototyping,  the  process  al¬ 
lowing  designers  to  produce  prototypes 
quickly,  avoiding  the  time  and  cost  of  tooling 
and  cutting  processes. 

In  addition  to  on-site  installations  at  major 
developers,  stereolithographic  services  are  be¬ 
ing  provided  by  3-D  CAM,  a  service  company 
located  in  Canoga  Park,  Calif.  General  Motors 
recently  imposed  a  prerequisite  that  all  parte 
requiring  tooling  must  employ  stereolittiogra- 
phy.  To  comply  with  this  requirement,  they 
have  seven  stereolithography  machines.  A 
discussion  of  the  costs  of  this  equipment  ap¬ 
pears  later  in  this  report. 

The  principal  advantages  of  stereolithogra¬ 
phy  indude; 

— Rapid  Prototyping.  Prototypes  drat  can  be 
built  rapidly,  and  are  used  to  communicate 


quickly  and  realistically  the  appearance 
and  major  functional  requirements  of  any 
product.  It  is  a  logical  progression  from 
auto  CAD  machines  with  their  2-D  models 
to  3-D  prototypes.  The  1/200  (1.5  ft.)  scale 
model  of  a  Green  Bank  Telescope,  built  by 
National  Radio  Astronomy  Organization, 
will  be  the  largest  steerable  radio  telescope 
in  the  world.  See  Figure  13. 

—  A  stereolithographic  model  was  produced 
from  a  CAD  files  in  10  weeks  by  3D-CAM 
Inc.  Engineers  from  Jet  Propulsion  Labora¬ 
tory  created  a  file  of  data  points  with  di¬ 
mensions  of  components  and  2-D  drawings 
with  Pro/Engineer  software  from  Paramet¬ 
ric  Technology,  Waltham,  Mass.  Then,  the 
data  was  converted  into  "STL"  files  — 
stereolithography  compatible  file  format  at 
3D-CAM.  The  antenna  structure  is  a  truss 
corrstruction  of  more  than  6S00  pipes.  The 
model  was  tested  in  a  wind  tunnel  with 
winds  up  to  70  mph.’^ 

—  Concurrent  Engineering.  Prototypes  are  a  di¬ 
rect  link  to  the  production  process  —  in¬ 
vestment  casting,  die  casting,  rotatiorral 
casting,  sand  casting,  injection  molding, 
blow  molding  and  thermofolding.  With 
prototypes,  design  engineers  can  better  as¬ 
sess  and  modify  designs  to  meet  user  re¬ 
quirements  and  manufacturing  capabilities. 
Stereolithographic  parte  also  make  it  easier 
to  test  accurately  for  fit  and  possible  inter¬ 
ference.  The  process  was  used  by  3D-CAM 
to  produce  a  magnesium  motorcycle  wheel 
in  20  days.’® 

— Procurement  and  Fabrication.  Models  en¬ 
hance  communication  witii  vendors.  A 
company  can  send  prototypes  to  vendors 
of  complex  parts  or  subassemblies  for 
quotes. 

— Marketing.  Models  can  be  shown  to  custom¬ 
ers  to  demonstrate  the  physical  properties 
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of  the  product  and  making  design  modifi- 
cations  before  tooling  production. 

Other  items  made  using  stereolithography 
demonstrated  the  full  range  of  applications.  A 
master  stereolithography  part  was  used  to 
make  silicone  rubber  molds  that  were  later 
used  to  cast  accurate  prototypes  in  polyure¬ 
thane  or  epoxy  material  wift  close  resem¬ 
blance  to  the  thermoform  plastics  of  the  fimd 
product.  It  provides  for  rapid  prototyping 
since  parts  take  hours  instead  of  weels  to 
build,  reducing  overall  costs. 

Stereolithography  systems  are  expeirsive.  The 
3-D  Systems  SLA  250  is  capable  of  producing 
parts  as  large  as  a  10  inch  cube  and  the  SLA- 
500  can  produce  parts  as  large  as  a  20  inch 
cube.  The  systems  range  in  price  from 
$120,000  to  $420,000  including  the  cost  of  the 
laser  system,  a  work  station,  and  a  curing 
oven.  As  promising  as  the  technology  sounds, 
however,  sales  by  3-D  Systems  after  growing 
in  the  late  1980s  fell  in  1991  and 


VIRTUAL  PROTOTYPING 

The  DOD  defines  a  virtual  prototype  as: 

A  computer-based  simulation  of  a  sys¬ 
tem  or  subsystem  with  a  degree  of  func¬ 
tional  realism  comparable  to  a  physical 
prototype;^^ 

and  virtual  prototyping  as; 

The  process  of  using  a  virtual  proto¬ 
type,  in  lieu  of  a  physical  prototype,  for 
test  and  evaluation  of  specific  charac¬ 
teristics  of  a  candidate  design}^ 

A  virtual  prototyping  enviromnent  is  a  mul¬ 
tidisciplinary  collection  of  models,  simula¬ 
tions  and  simulators  focused  to  guide  product 
design  from  idea  to  prototype,  emphasizing 
subsystem  optimization  and  integration 


rather  than  hardware.  In  the  context  of  mili¬ 
tary  procurement,  a  virtual  prototyping  envi- 
rorunent  would  address:  engineering  design 
concerns  of  the  developer,  process  concerns  of 
the  manufacturer,  logistic^  concerns  of  the 
maintainer,  and  training  and  doctrinal  con¬ 
cerns  of  the  warfighter. 

A  new  generation  of  simulations  is  envi¬ 
sioned  that  will  enable  creation  of  realistic 
synthetic  battlefields  bringing  warfighters, 
developers,  scientists,  engineers  testers  and 
manufacturers  together.  Virtual  prototypes 
will  be  tested  in  simulated  combat  environ¬ 
ments.  Concepts  will  be  explored  before 
bending  metal;  system  attributes  and  capa¬ 
bilities  can  be  changed  rapidly  on  the  syn¬ 
thetic  battlefield.  Once  a  concept  is  approved, 
design  and  manufacturing  trade-offs  will  be 
conducted  on  the  virtual  prototype  to  en¬ 
hance  producibility  and  elinunate  the  need 
for  a  physical  prototype. 

The  concept  of  a  virtual  prototype  and  the  ap¬ 
plication  of  virtual  prototyping  is  a  critical 
element  of  the  Science  and  Technology  (S&T) 
Program  and  its  goal  of  minimizing  and  ac¬ 
commodating  a  smaller  force  structure,  im¬ 
proving  joint  operations,  and  retairung  the 
technological  edge  against  all  potential 
threats.  The  S&T  Thrust  Six,  Synthetic  Envi¬ 
ronments  and  Thrust  Seven,  Technology  for 
Affordability  incorporate  the  virtual  proto¬ 
typing  concept  in  the  overall  S&T  Program. 

Synthetic  environments  are  defined  by  the 
Defense  Modeling  and  Simulation  Office 
(DMSO)  as  intemetted  simulatiorrs  that  repre¬ 
sent  activities  at  a  high  level  of  realism  from 
simulations  of  theatres  of  war  to  factories  and 
manufacturing  processes.  These  environ¬ 
ments  are  fundamentally  different  from  the 
traditional  simulations  and  models  known  to¬ 
day.  They  are  created  by  confederations  of 
computers,  cormected  by  local  and  wide  area 
networks  and  augmented  by  super  realistic 
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Figure  14.  Synthetic  Environments  (Source:  DDR&E) 


special  effects  and  accurate  behavioral  models 
which  allow  visualization  of,  and  total  im* 
mersion  into,  the  environment  being  simu¬ 
lated.^  It  is  envisioned  that  virtual  prototypes 
will  be  inserted  in  synthetic  battlefields,  con¬ 
sisting  of  a  simulation  of  the  components  of 
an  actual  battlefield  (air,  land  and/  or  sea),  to 
assess  system  capabilities  during  the  acquisi¬ 
tion  process.  Once  systems  are  fielded,  simu¬ 
lations  will  be  used  for  training,  doctrine  and 
oiganizational  piuposes.  See  Figure  14. 

At  a  synthetic  environments  conference  in 
Decem^r  1992,  the  Acquisition  Research  Pro¬ 
ject  Agency  (AREA)  representatives  stated, 
"Emulation  represents  an  opportunity  for  the 
acquisition  community  to  t^e  full  advantage 
of  advanced  distributed  simulation  throu^- 
out  the  development  cycle  within  the  war- 
ffghter's  environment"  Colonel  Jack  A. 
Thorpe,  USAF  (Ret),  Special  Assistant  for 
Simulation  at  AREA,  envisions  that  by  the  end 
of  the  decade  using  simulation  we  will  have 


the  capability  to  visualize  the  battlefield  as 
the  warfighter  sees  it,  and  our  combat  forces 
will  always  be  at  "war"  in  a  Louisiana  Ma¬ 
neuvers  12  months  a  year;  thus,  enabling 
mastery  of  joint  warfighting  doctrine.^ 

Principal  challenges  of  synthetic  environ¬ 
ments  and  virtual  prototypes  include  creating 
enviromnents  that  are  meaningful  and  realis¬ 
tic  to  hiunan  participants;  having  computers 
accurately  represent  human  behavior;  creat¬ 
ing  environments  that  accurately  describe 
real-worid  places;  and  comiecting  globally  lo¬ 
cated  sites  economically.^* 

A  recent  MITRE  study  concluded  that  the  fol¬ 
lowing  must  be  accomplished  in  order  to  reap 
the  full  benefits  of  syndetic  envirorunents:^ 

—  Technology.  Models  need  to  be  more  cred¬ 
ible  reflecting  a  broad  spectrum  of  behav¬ 
ioral  and  enviromnental  effects; 
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—  Strategy.  A  well-articulated  simulation 
strategy  is  required  at  the  outset  of  a  pro¬ 
gram; 

—  Evolution.  The  government  and  contractor 
need  to  develop  a  game  plan  addressing 
the  environment  and  system  operation  in 
the  en\ironment; 

—  Verification,  Validation  and  Accreditation 
(VV&A).  A  practical  approach  needs  to  be 
promulgated. 

The  objective  of  Thrust  Seven,  Technology  for 
Affordability,  is  to  reduce  costs  and  the  time  it 
takes  to  make  an  acquisition.  According  to 
ARPA,  the  targeted  capabilities  are:^* 

—  Simulation-based  evaluation  of  require¬ 
ments  and  capabilities 

—  Integrated  product  and  process  develop¬ 
ment 

—  Responsive,  flexible  manufacturing  proc¬ 
esses 

—  Integrated  enterprise  systems  and  supplier 
relationships 

—  Integrated,  real-time  management  control 
systems. 

Virtual  prototypes  are  an  important  ingredi¬ 
ent  to  the  success  of  these  initiatives.  Pro¬ 
duced  today  with  existing  CAD/CAM  tools, 
they  offer  tremendous  potential  for  reducing 
costs,  yielding  more  robust  designs,  and 
shortening  manufacturing  cycle  times.  Com¬ 
panies  are  reaping  signihcant  benefits  from 
using  virtual  prototypes  and  achieving  the  ca¬ 
pabilities  desired  of  Thrust  Seven.  Companies 
are  finding  physical  prototypes  are  no  longer 
necessary  and  simulation-based  tools  enable 
them  to  achieve  competitive  advantage.  It  is 
important  to  note  these  advantages  are  being 


accomplished  using  existing  computer  tools 
at  current  costs.  As  t!..,  capabilities  of  these 
tools  grow  and  costs  lessen,  companies  will 
have  no  choice  but  to  use  virtual  prototypes 
to  compete. 

The  concept  of  the  "virtual  factory"  is  also 
part  of  Thrust  Seven.  A  simulated  factory 
could  be  used  to:  identify  designs  requiring 
modification  to  enhance  produdbility;  deter¬ 
mine  which  processes  should  be  automated; 
assess  the  feasibility  of  dual-irse  technologies, 
and  calculate  surge  capability.  Research  is  tak¬ 
ing  place  on  the  "virtual  factory"  where  the 
concepts  of  rapid  prototyping,  flexible  manu¬ 
facturing,  commercial  vs.  military  require¬ 
ments,  and  industrial  base  issues  are  being 
explored.  The  number  of  applicabons,  how¬ 
ever,  are  extremely  limited. 

VIRTUAL  REALITY 

Virtual  reality  (VR)  is  a  subject  of  enormous 
curiosity  to  government,  industry  and  acade¬ 
mia.  The  term  is  often  used  interchangeably 
with  a  nurr-ber  of  related  names  such  as  vir¬ 
tual  environment,  telepresence,  virtual  proto¬ 
typing,  electronic  battlefield,  virtual  factories, 
synthetic  environments,  scienbfic  visualiza¬ 
tion,  cyberspace,  etc.^^  Confusion  over  the 
definition  stems  from  the  vast  array  of  poten¬ 
tial  customers  eager  to  characterize  their 
product  as  "virtual."  Laying  the  hype  aside, 
the  technology,  according  to  experts  in  the 
field,  offers  great  potenbal  in  science  and  en¬ 
gineering  research,  education,  entertainment, 
design,  financial  analysis  and  defense  simula¬ 
tion.  The  operative  word  is  "potenbal"  be¬ 
cause  most  applications  are  concentrated 
primarily  in  the  entertainment  field  where 
Hollywood  views  visualization  as  a  locomo¬ 
tive  for  the  future  of  growth  in  digital  tech¬ 
nology  and  VR.  Recently,  IBM  Corporation 
entered  into  a  joint  venture  with  Digital  Do¬ 
main  where  it  hopes  to  reignite  its  growth  by 
sparking  demand  for  powerful  computeis 
and  software  needed  to  handle  huge  amounts 


28  -  Spectrum  of  Synthetic  Environments 


Virtual  Prototyping:  Concept  to  Production 


Head  Mounted  Display 
(Enclosed) 

\ 


Figure  15.  Equipment  Used  in  a  Virtual  Environment  (Source:  NASA/ Ames) 


of  digitized  visual  information,  such  as 

special-effects  movies  and  video  confer- 
28 

ences. 

The  best  description  of  VR  comes  from  Dr. 
Thomas  A.  Furness  III,  Director  of  the  Human 
Interface  Technology  Laboratory,  a  division  of 
the  Washington  Technology  Center,  Univer¬ 
sity  of  Washington:” 

Virtual  rtaiity  is  an  environment  that  you  create 
using  a  combination  (^visual,  auditory,  images  - 
things  that  you  see,  things  that  you  hear,  things 
that  you  feel  -  that  appear  to  be  coming  from  a 
location  in  space,  but  aren't  really  there.. 

Harold  Rheingold  expands  upon  this  in  his 
book.  Virtual  Reality,  by  characterizing  VR 
as:^ 

The  ultimate  computer  interface.  The 
virtual  world  is  a  computer  that  you  op¬ 


erate  with  natural  gestures,  not  by  com¬ 
posing  computer  programs,  but  by 
walking  around,  looking  around,  and 
using  your  hands  to  manipulate  objects. 

The  essence  of  virtual  reality,  and  its  many  re¬ 
lated  terms,  is  the  capability  of  providing  a 
means  to  visualize  complicated  systems  and 
databases  and  to  produce  simulations  in  a 
real  time,  seamless  network  of  models.  A  vir¬ 
tual  system  must  have  the  following  mini¬ 
mum  attributes: 

—  Authenticity.  It  must  be  perceived  as  real 
and  authentic 

—  Immersion.  It  must  immerse  humans  so  in¬ 
teractions  with  this  environment  are  intui¬ 
tive 

—  Validation.  It  must  be  validated  and  accred¬ 
ited  for  the  application 
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— Interaction.  It  must  be  interactive  and  rap¬ 
idly  reconfigurable. 

The  equipment  utilized  in  a  virtual  environ¬ 
ment  is  depicted  at  Figure  15,  courtesy  of  the 
NASA  Ames  Research  Center.  The  system 
consists  of:  a  wide-angle  stereoscopic  display 
uiut,  glove-like  devices  for  multiple  degree- 
of-freedom  tactile  input,  connected  speech 
recognition  technology,  3-D  sound  cueing  and 
speech  synthesis  technology,  and  gesture 
tracking  devices.^'  To  create  the  visual  illu¬ 
sion,  two  slightly  different  computer-gener¬ 
ated  views  are  projected  on  tiny  liquid  crystal 
screens  mside  ^e  goggles.  This  produces  the 
3-D  effect  of  normal  vision,  created  by  the  fact 
that  neither  eye  perceives  the  same  thing  from 
exactly  the  same  perspective.^^ 

The  VR  equipment  is  expensive.  The  VPL  Re¬ 
search  of  Redwood  City,  Calif.,  principal  sup¬ 
plier  of  VR  headsets  and  data  gloves,  sells  the 
headsets  for  $10,000  to  $49,000  each  and  the 
gloves  for  $8,800.  Most  existing  VR  systems 
require  the  power  of  a  supercomputer.  The 
\TL  system  uses  two  powerful  Silicon  Graph¬ 
ics  computers,  one  for  each  eye.  Total  system 
cost  can  easily  run  to  $250,000  and  more.  To 
reach  the  mass  market,  costs  must  be  cut 
drastically. 

Mattel  markets  a  $50  version  of  the  data 
glove.  Controlled  by  a  $99  Nintendo  game 
cartridge,  the  glove  allows  its  user  to  play  vir¬ 
tual  handball  on  a  virtual  court  against  a  vir¬ 
tual  opponent.  Since  introducing  the  glove  in 
1989,  Mattel  has  sold  a  million  of  them.  The 
VPL  is  working  on  a  $200  data  glove  for  PC 
users.  Add  a  pair  of  stereo  glasses  ($1300), 
put  a  virtual  reality  chip  board  (another 
$1,(XX)  to  $2,{K)0)  in  your  PC,  and  off  you  go 
into  an  inexperrsive  version  of  artificial  reality 
with  a  cartoon-like  quality.^^ 

One  of  the  biggest  challenges  facing  re¬ 
searchers,  according  to  Frederick  P.  Brooks,  Jr., 


a  professor  in  the  computer  science  depart¬ 
ment  of  the  University  of  North  Carolina  at 
Chapel  Hill,  is  reconciling  realism  with  inter¬ 
activity.  Real-time  motion,  complex  world 
models,  and  high-quality  images  create  a 
workload  that  overwhelms  todays  hard¬ 
ware.^  Visual  images  in  today's  head- 
mounted  displays  are  cartoon-like,  and  the 
headsets  are  bulky  due  to  the  awkward  um¬ 
bilical  cable,  which  restricts  movement,  con¬ 
nected  to  the  computer.  Another  problem  is 
the  tendency  of  some  operators  to  become  ill 
while  using  the  head-mounted  displays. 

The  term  virtual  reality  is  new  but  much  of 
what  we  know  about  personal  computing 
grew  directly  from  Engelbart's  Augmentation 
Research  Center  (ARC)  at  the  Stanford  Re¬ 
search  Institute  in  the  1960s  where  several  VR 
taproots  originated.  Today,  simulation  tech¬ 
nology  has  advanced  to  permit  "sensory 
overload"  through  all  human  receptors  simul¬ 
taneously  —  visual,  auditory,  haptic  and  mo¬ 
tion  interfaces.  The  term  'Traptic"  refers  to 
any  variety  of  manual  interactions  with  the 
environment. 

Systems  are  extremely  complex  and  must  rap¬ 
idly  interact  in  proper  context  with  many  dis¬ 
parate  entities.  A  VR  machine  is  intended  to 
immerse  humans  into  real-time  interactions 
so  they  may  leam,  train,  test,  have  fun  or  un¬ 
derstand  and  optimize  processes  and  sys¬ 
tems.  The  virtual  environment  could  also  be 
selectively  constrained  by  policies,  resources, 
tactics,  or  strategies  to  correctly  represent  the 
customer  issues. 

Scores  of  conferences,  working  groups,  and 
other  forums  have  discussed  virtual  reality 
and  related  topics.  Most  of  these  conferences 
have  focused  on  the  technical  aspects  of  vir¬ 
tual  reality  but,  increasingly,  issues  of  policy, 
management  and  resources  are  being  dis¬ 
cussed.  It  is  beyond  the  scope  of  this  report  to 
summarize  the  outcomes  of  all  those  meet- 
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ings;  however,  it  would  be  instructive  to  focus 
on  two  of  these  conferences  —  IMAGE  VI,  at 
Scottsdale,  Ariz.,  17-18  July  1992,  and  Virtual 
Interface  Technology  (Virtual  Reality),  at 
UCLA,  15-17  March  1993  —  to  emphasize 
current  issues  and  applications. 

Most  commonly  used  terminology  in  the  IM¬ 
AGE  VI  conference  was  "virtual  environ¬ 
ment."  Nine  of  the  virtual  environment 
papers  covered  topics  such  as  virtual  technol¬ 
ogy  training,  implications  for  networked  tacti¬ 
cal  training,  battie  staff  planning  and  mission 
rehearsal,  advanced  networking  technologies, 
dynamic  terrain  databases,  decision  support 
environment  for  tactical  C2,  mapping,  chart¬ 
ing  and  geodesy  synergism,  standard  simula¬ 
tor  databases  and  interoperability  of  visual 
simulation  systems.^® 

The  ^rtual  Interface  Technology  (Virtual  Re¬ 
ality)  conference  addressed  virtual  interface 
concepts,  human  factors  considerations,  heud- 


ware  capabilities  and  software  considerations. 
They  defined  "virtual  world/ virtual  environ¬ 
ment/virtual  reality"  as:^* 

The  representation  of  a  computer  model 
or  database  in  the  form  of  a  system  of 
virtual  images  which  creates  an  interac¬ 
tive  environment  which  can  be  experi¬ 
enced  andlor  manipulated. 

Dr.  Tom  Furness,  Director  of  the  Human  In¬ 
terface  Technology  Laboratory  of  the  Univer¬ 
sity  of  Washington,  and  former  Chief  of  the 
Visual  Display  Systems  Branch,  Human  Engi¬ 
neering  Division  of  the  Armstrong  Aerospace 
Medical  Research  Laboratory  at  Wright-Pat- 
terson  Air  Force  Base,  Ohio,  led  the  course. 
While  with  the  Air  Force,  his  staff  pioneered 
advanced  interface  concepts  for  fighter  air¬ 
craft  including  the  Super-Cockpit 

He  explained  the  relationship  between  the 
physical  or  real  world  with  virtual  reality  by 
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comparing  mental  models  in  each  environ¬ 
ment:  the  message  (what  cne  sees),  the  me¬ 
dium  (the  display  device)  and  the  physical 
environment.  &e  Figure  16.  In  the  virtual  en¬ 
vironment,  the  message  and  the  environn^t 
are  synonymous,  the  medium  nonexistent. 
The  user  becomes  the  part  of  the  message 
where  the  he  or  she  can  interact  with  the  envi¬ 
ronment  A  spectator  becomes  a  participant 

The  primary  advantage  of  VR  is  its  potential 
to  empower  humans  by  developing  better 
ways  to  interact  with  computers.  According 
to  Dr.  Furness,  people  see  images,  not  objects. 
He  goes  on  to  explain  that  there  are  three 
kinds  of  visual  thinking:  1)  the  kind  we  see 
from  objects;  2)  the  kind  we  imagine,  such  as 
visual  images  while  reading  a  book;  and  3) 
the  kind  we  create  ourselves  when  we  write 
or  draw.  The  region  of  maximum  creativity  is 
where  all  three  kinds  of  visual  thinking  over¬ 
lap  —  the  virtual  world.  See  Figure  17.  The 
key  to  empowering  humans  with  virtual  real¬ 
ity  is  to  make  the  computer  more  human-like 
rather  than  requiring  the  human  to  be  more 
machine-like. 

The  capabilities  of  tfie  Super  Cockpit  best  rep- 
reoent  the  capabilities  of  machines  in  the  vir¬ 
tual  world  so  it  is  worthy  of  a  brief 
discussion.  Dr.  Furness  described  the  virtual 
cockpit  as  a  control  and  display  medium 
which  oiganizes  and  fuses  information  from 
aircraft  subsystems  and  portrays  this  infor¬ 
mation  in  the  form  of  a  visual,  auditory  and 
tactile  circumambience  for  rapid  assimilation 
by  the  pilot.  The  simulator  enables  pilots  to 
operate  complex  aircraft  widi  natural  hand 
and  eye  movements  and  voice  control. 

A  representation  of  a  super  cockpit  display 
scene  is  in  Rgure  18.  A  pilot  might  view  this 
scene  when  flying  at  low  altitude.  It  is  pro¬ 
jected  to  the  pilot  in  three  dimensions  and 
overlays  the  real  world  with  a  one-to-one  spa¬ 
tial  registration.  Critical  information  is  no 


longer  compressed  into  small  two-dimen¬ 
sional  representations,  but  now  surrounds  the 
pilot  and  is  seen  in  three  dimensions  relevant 
to  the  location  of  the  information  source.  For 
example,  the  artificial  horizon  normally  pre¬ 
sented  in  the  attitude  direction  indicator  now 
appears  as  a  panoramic  horizon  surrounding 
the  pilot  and  overlayed  on  the  real  world.  The 
heading  compass  now  appears  impressed 
over  the  horizon  instead  of  in  a  horizontal 
situation  indication  in  the  cockpit.  Targets, 
navigation  waypoints,  threats,  etc.,  now  ap¬ 
pear  where  they  really  are  in  space,  radier 
than  in  a  small,  two-dimensional  presentation 
in  the  cockpit.  An  electronically  inserted  "rear 
view  mirror"  also  conveys  visually  to  the  pi¬ 
lot  what  may  be  behind  hirrt 

These  displays  are  augmented  witir  audible 
and  tactile  displays.  The  auditory  display 
gives  the  pilot  a  three-dimensional  sound 
which  provides  localization  cues  to  the  loca¬ 
tions  of  different  targets,  aircraft,  threats,  etc. 
Warning  signals  are  perceived  as  coming  from 
a  particular  point  in  the  cockpit.  A  synthe¬ 
sized  speaker  can  even  whisper  in  his  ear  in¬ 
formation  which  carmot  be  ignored. 
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Figure  18.  Super  Cockpit  Display  Scene  (Source:  HITL) 


The  VR  has  tremendous  potential  in  the  en¬ 
tertainment  industry  where  significant  invest¬ 
ment  is  being  made.  Virtual  World 
Entertainment  IP's  VR  game  site  in  Chicago, 
the  "Battle-Tech  Center,"  sold  approximately 
3()0,(K)0  tickets  at  $7.00  each  between  July  and 
September  of  1992  to  players  who  sit  in  an  en¬ 
closed  cockpit  to  engage  in  Star  Wars-like  bat¬ 
tles.  The  comp<my  has  two  sites  in  Japan  and 
plans  to  open  17  or  more  over  the  next  three 
years.’^ 

Resolving  technical  and  resource  issues  de¬ 
pends  on  the  customer.  However,  issues  of 
policy  and  management  of  multicustomer 
synthetic  environments  may  have  to  be  deter¬ 
mined  at  a  higher  level  or  by  cooperation. 
Consider  the  range  and  variety  of  customers: 
education,  entertainment,  science  and  engi¬ 
neering,  defense  and  industry.  Then  consider 
only  the  Department  of  Defense  (IX)D)  and 
the  five  separate  customer  subgroups:  (1)  Re¬ 


search,  Development  and  Engineering,  (2) 
Education,  Training  and  Military  Operations, 
(3)  Test  and  Evaluation,  (4)  Analysis  and  Op¬ 
erations  Research,  and  (5)  Production  and  Lo¬ 
gistics.  Each  subgroup  has  a  different  role  in 
the  acquisition  process,  different  chciins  of 
command,  different  needs  for  fidelity,  repre¬ 
sentation  of  weapon  suites,  data  collection, 
and  characterization  of  human  interfaces. 
Each  synthetic  envirorunent  evaluation  or 
demonstration  within  DOD  must  satisfy  the 
appropriate  agencies  and  decision  makers  in 
accordance  with  existing  regulatiotrs.  Hence, 
implementation  of  VR  is  an  extremely  conv 
plex  DOD  undertaking. 

The  VR  has  the  potential  of  allowing  people 
to  interact  with  complicated  physical  proc¬ 
esses  through  three-dimension^  color  visuali¬ 
zation  and  can  enhance  understanding  and 
knowledge.  Its  proponents  argue  it  will  im- 
leash  the  creative  genius  of  individuals  and 
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transform  business  and  society.  However,  ap¬ 
plications  of  VR  are  rare  and  one  of  the  lead¬ 
ing  producers  of  head-mounted  displays 
recently  went  bankrupt  Surely  offering  great 
promise,  it  is  unclear  how  this  technology  will 
impact  defense,  business  and  society. 

SIMULATION 

Comparing  con^uter  modeling  and  simula¬ 
tion,  modeling  is  the  development  of  equa¬ 
tions,  constraints  and  lo^c  rules,  while 
simulation  is  the  exercising  of  the  model  over 
time.  Simulations  contain  models.  In  order  to 
systematically  discuss  simulation  in  general, 
the  topic  is  divided  into  classes.  There  are 
many  possible  ways  to  define  the  classes: 
techni({ue  of  implementation,  purpose  or  ob¬ 
jective,  level  of  detail,  linkage  between  mod¬ 
els,  size  of  time  units,  structure  of  simulation 
components,  deterministic  vs.  time  varying, 
continuous  vs.  discrete,  physical  models  vs. 
human  behavior  and  degree  of  human  inter¬ 
action,  to  name  a  few.  The  DMSO  defines 
three  classes  based  on  the  differing  evolving 
technologies  used  to  implement  each  class. 
The  definitions  are:* 

COMPUTER  MODELS.  Systems  and  forces 
and  titeir  interactknt  are  primly  represented  in 
computer  code.  The  modds  can  d^  gmatly  in 
die  levd  detail  of  the  representation,  and  there 
may  be  some  human  interaction  with  the  modd 
while  it  is  running. 

MANNED  WEAPON  SYSTEM  SIMULA 
TIONS.  Individual  weapon  systems  are  modeled 
(e.g.,  by  a  simulator)  and  typicady  controlled  by  a 
human  operator.  Principal  emphasis  is  on  the 
situation  where  die  rJioidud  simulations 
interact  togedier  throu^  a  distributed  network 
The  archetype  of  diis  doss  is  SIMNET. 

INSTRUMENTED  TESTS  AND  EXER¬ 
CISES.  Actual  troops,  weapon  systems  and 
utpport  systems  interact  in  as  real  an 
environment  as  possible,  coith  indrumentation 


being  used  to  collect  and  distribute  status  data  on 
die  force  dements.  Actwitks  at  the  National 
Thdning  Center  are  a  represeritatwe  example. 

A  similar  classification  scheme  appearing  in 
informal  papers  within  DOD  defines  the  fol¬ 
lowing  three  classes  of  simulations: 

CONSTRUCTIVE.  Wargfrmes,  models  and 
analytic  took  developed  by  the  individual 
Services. 

VIRTUAL  Systems  simulated  both  physically 
and  by  computer.  Real  people  fi^t  on  synthetic 
battlefidds,  interacting  with  each  other  cind  with 
art^xts  in  the  smtulatkm.  Examples  include 
individud  aircrafl  simulators  and  virtual 
prototypes. 

LIVE.  Operations  with  live  forces  and  rail 
equipment  in  the  air,  on  the  ground,  on  and  below 
the  sea.  Also  included  are  hardware  prototypes  on 
instrumented  ranges. 

ISSUES  IN  SIMULATION 
A  number  of  issues  concerning  the  implemen¬ 
tation  of  simulations  need  to  be  discussed  to 
undeistand  better  how  well  simulations  can 
serve  their  intended  purpose.  These  issues  are 
particularly  important  when  using  interactive 
simulations  and  defining  a  synthetic  battle¬ 
field  for  conducting  virtual  baMes. 

First,  consider  the  level  of  detail  in  a  simula¬ 
tion.  Level  of  detail  can  be  expressed  as  "fi¬ 
delity"  —  the  physical  correspondence  of  the 
hardware  to  actual  equipment;  "realism"  — 
the  subjective  perceptions  of  the  people  using 
the  simulation;  and  "validity"  —  the  suitabil¬ 
ity  of  the  simulation  for  a  speciric  applica¬ 
tion.* 

The  term  "fidelity"  is  often  used  to  refer  to  all 
types  of  the  level  of  detail  in  a  simulation. 
There  is  a  trade-oF  between  the  amount  of  fi¬ 
delity  and  the  cost  of  implementing  file  simu- 
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lation.  Greater  fidelity  means  greater  cost  to 
design,  build  and  maintain  the  simulation 
and  increased  computer  power  to  run  the 
software.  Rather  than  assume  one  should  buy 
all  the  fidelity  one  can  afiord,  the  intended 
purpose  of  the  simulation  must  be  consid¬ 
ered.  Simulations  for  operator  training  may 
have  too  much  realism  which  can  interfere 
with  learning  basic  skills  and  procedures. 
Models  in  a  simulation  may  range  from  single 
weapon  systems  to  phenomena  addressing 
theater  and  campaign  warfare,  and  modeling 
individual  infantry  soldiers  in  a  theater  level 
simulation  is  unlikely  to  improve  upon  the  in¬ 
tended  purpose  of  the  simulation. 

The  cost  of  computer  power  to  generate  a  de¬ 
sired  level  of  fidelity  is  an  important  trade-off 
given  the  limitations  of  today's  computer 
technology.  This  is  especially  true  when  gen¬ 
erating  visual  images  on  a  synthetic  battle¬ 
field.  Unfortunately,  the  computing  power 
reasonably  available  today  falls  short  of  that 
needed  to  produce  high-quality  images.  How¬ 
ever,  acceptable  and  highly  useful  visual 
simulations  can  be  built  using  today's  tech¬ 
nology. 

Second,  there  is  a  need  to  provide  semiauto- 
mated  forces  which  mimic  human  behavior. 
Virtual  (interactive)  simulations  are  more  ef¬ 
fective  when  fighting  wifii  and  against  intelli¬ 
gent  forces.  Simulating  an  Army  division  in 
combat  can't  be  accomplished  reasonably  us¬ 
ing  a  division  complement  of  simulator  op¬ 
erators.  Rather,  semiautomated  forces  are 
needed  to  provide  friendly  and  enemy  forces 
who  respond  with  realism  to  the  terrain, 
available  weapon  systems,  orders  from  higher 
echelons,  self-preservation  actiorrs,  and  ac¬ 
tions  of  other  forces.  Individual  infantry  men 
need  to  be  automated.  The  actions  of  semi¬ 
automated  forces  must  aggregate  to  produce 
acceptable  behavior  of  higher  echelon  forma¬ 
tions.  Models  of  realistic  human  performance 
and  decision  making  need  to  be  validated. 


Implementing  this  degree  of  realism  will  re¬ 
quire  a  significant  investment  in  software  de¬ 
velopment. 

Third,  terrain  databases  for  synthetic  battle¬ 
fields  need  sigruficant  improvement.  The  fi¬ 
delity  of  terrain  databases  need  to  be 
increased  to  provide  more  realism  by  includ¬ 
ing  soil  conditions,  vegetation,  weather  ef¬ 
fects,  more  precise  elevation  data, 
electromagnetic  effects,  water  obstacle  depth 
and  flow  rates,  obscurants  and  wind  effects 
and  improved  detail  for  man-made  objects. 
Also,  the  terrain  database  needs  to  be  auto¬ 
mated  so  changes  to  the  terrain,  such  as  battle 
damage  and  excavation,  are  made  during  a 
simulated  battle.  A  synthetic  battlefield  must 
present  the  same  conditions  to  all  partici¬ 
pants.  It  is  not  acceptable  to  have  one  weapon 
system  believe  it  is  concealed  by  a  terrain  fea¬ 
ture  in  its  database  while  a  second  weapon 
system  is  able  to  "see  through"  the  nonex¬ 
istent  feature.  Nor  is  it  acceptable  to  allow  ve¬ 
hicles  to  drive  across  the  surface  of  lakes. 
Realistic  terrain  will  help  provide  greater  con¬ 
fidence  in  the  conclusions  resulting  from 
simulated  battles. 

Last,  there  are  many  unresolved  issues  con¬ 
cerning  W&A  of  synthetic  batfiefields  and 
simulated  weapon  systems.  Within  DOD, 
who  has  the  responsibility  for  accrediting 
synthetic  battlefields  and  how  will  it  be  ac¬ 
complished?  Standards  need  to  be  established 
and  software  tools  built  to  facilitate  W&A.  If 
synthetic  battlefields  are  to  be  used  to  make 
major  acquisition  decisions,  VV&A  becomes 
crucial  to  success. 

TECHNOLOGY  ASSESSMENT 
Of  all  the  enabling  technologies  which  make 
virtual  prototyping  possible,  shown  in  Figure 
19,  many  are  commercially  driven;  conse¬ 
quently,  IX)D  can  benefit  from  advances 
made  in  the  commercial  market.  Other  tedi- 
nologies  are  of  interest  prinuirily  to  DOD  and 
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ENABLING  TECHNOLOGIES 


Commercially  Driven 

Database  management  systems 
Man-machine  Interfaces 
Software  engineering  tools 
Local  and  wide  area  networks 
High  performance  computers 
Computer  image  generators 
Microcomputer  systems 
Microprocessors 
Memory 
Mass  storage 
Display  devices 


POD  Driven 

Manufacturing  process  simulations 

Engineering  design  models 

Manned  simulators 

Stochastic  wargaming  simulations 
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Figure  19.  Enabling  Technologies  Making  Virtual  Protototyping  Possible 


will  require  funding  and  careful  management 
to  produce  useful  results.  The  DMSO  has 
identified  eight  key  technology  "areas"  which 
provide  the  foundation  for  modeling  and 
simulation:  database  technologies,  environ¬ 
mental  representation,  networking,  software 
engineering,  behavioral  representation,  in¬ 
strumentation,  graphics,  and  computer  hard¬ 
ware.^  Described  below  is  the  status  of 
several  of  these  key  areas. 

Computer  Hardware 

During  the  last  decade,  computer  hardware 
has  improved  continuously  in  processor 
speed  and  memory  capacity;  at  the  same  time, 
costs  have  declined.  Supercomputers  and 
mainframes  capable  of  high  computational 
speeds  and  workstations  and  minicomputers 
capable  of  running  lar^e  simulations  are  now 
available.  The  pace  of  generation  turnover. 


with  each  generation  representing  at  least  a 
doubling  of  capability  and  possibly  a  change 
in  basic  technology,  is  one  to  two  years,  de¬ 
pending  on  the  component.  Microprocessors 
and  microcomputer  systems  turn  over  each 
two  to  three  years,  memory  and  mass  storage 
each  three  years,  local  area  networks  and  dis¬ 
play  technology  each  four  years,  and  com¬ 
puter  image  generators  each  five  years.  This 
growth  is  fueled  by  the  commercial  sector  and 
not  DOD. 

The  growttx  trend  is  expected  to  continue 
throughout  the  remainder  of  this  decade."*' 
Estimates  of  growth  from  1993-98  are  t^’at 
processor  performance  will  grow  from  the 
current  50  nullion  floating  point  operations 
per  second  (Mflops)  to  1500  Mflops.  Memory 
chip  density  will  grow  from  4  nullion  bits 
(Mbit)  per  unit  area  to  256  Mbits.  Local  area 
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network  perfoiroance  will  grow  from  the  cur¬ 
rent  10  iiullion  bits  per  second  (Mbps)  Eth¬ 
ernet  and  100  Mbps  Fiber  Distributed  Data 
Interface  (FDDI)  to  more  than  500  giga  bits 
per  second  (Gbps).  One  Gbps  equals  1,000 
Mbps.  Wide  area  networks  will  increase 
throughput  from  T1  rates  of  1.5  Mbps  to  2.4 
Gbps.  Computer  image  generators  currently 
process  10,000  polygons  per  second  and  are 
expected  to  be  a  thousand  times  faster  by 
19^.  The  two  primary  driving  forces  behind 
the  growth  trend  are  integrated  circuit  den¬ 
sity  and  parallel  computing  architectures.  At 
current  growth  rates  the  physical  limits  of  in¬ 
tegrated  circuit  construction  will  be  met;  how¬ 
ever,  benefits  of  parallel  architectures  are  just 
beginning  to  be  implemented  in  commercial 
products. 

The  University  of  North  Carolina  at  Chapel 
Hill  has  developed  a  parallel  architecture 
multicomputer  called  the  Pixel-Planes  5 
which  provides  high  performance  3-D  graph¬ 
ics  generation  at  the  rate  of  100,000  polygons 
pjer  second  and  is  capable  of  generating  2  mil¬ 
lion  polygons  per  second  with  a  fully  config¬ 
ured  system  A  polygon  is  defined  as  a 
two-dimensional  figure  whose  characteristics 
are  described  with  approximately  100  bits  of 
information.  Using  a  ring  network  of  special¬ 
ized  graphics  processors  and  separate  render- 
ers,  each  with  its  own  memory,  the 
multicomputer  rapidly  draws  finely  detailed 
images  widi  advanc^  lighting  models  and 
textures.  Commercial  image  generators  oper¬ 
ate  at  a  rate  of  10,000  polygons  per  second, 
making  the  Pixel-Planes  5  multiprocessor  an 
exceptional  perfonner  by  comparison. 

Computer  Software 

Spectacular  improvement  in  computing  hard¬ 
ware  alone  is  not  sufficient  to  ensure  major 
improvement  in  simulation  capability.  Soft¬ 
ware  development  tools  which  allow  rapid 
construction  of  simulations  and  virtual  proto¬ 
types  are  almost  nonexbtent. 


The  Human  Interface  Technology  Laboratory, 
University  of  Washington,  is  building  a  Vir¬ 
tual  Environment  Operating  System  (VEOS) 
to  provide  a  seamless  environment  which  will 
couple  humans  into  a  virtual  environment, 
manage  simulation  processes,  and  integrate 
the  output  signals  to  display  devices.  An  op¬ 
erating  system  such  as  VEOS  can  provide  a 
standard  interface  for  software  developers,  al¬ 
lowing  easy  integration  of  products  from  di¬ 
verse  sources  and  reusable  software.  The 
VEOS  will  be  public  domain  software.^^ 

A  commercial  virtual  reality  operating  envi¬ 
ronment  titled  "dVS"  is  available  from  Divi¬ 
sion,  Inc.  This  system  provides  high 
performance  operation  across  multiple  hard¬ 
ware  platforms  and  software  tools  to  allow 
structured  design  of  virtual  reality  applica¬ 
tions.  More  than  20  dVS  systems  are  in  opera¬ 
tion,  providing  3-D  immeisive  virtual  reality 
applications  such  as  architectural  building 
walk-tirrough  and  product  design  visualiza¬ 
tion. 

Head-Mounted  Displays 
A  head-mounted  display  gives  the  user  the 
sensation  of  being  immersed  in  a  3-D  com¬ 
puter-generated  environment.  Head-mounted 
displays  provide  stereoscopic  views  by  gener¬ 
ating  a  separate  image  for  each  eye.  By  track¬ 
ing  head  movements  and  position,  the 
computer  generated  scene  can  be  adjusted  to 
any  point  of  view.  The  user  can  move  through 
the  environment  and  turn  and  look  in  any  di¬ 
rection.  Tracking  can  be  accomplished  by  sev¬ 
eral  means;  i.e.,  movement  of  a  sensor 
through  a  magnetic  field,  sensing  light  emit¬ 
ting  diodes  (LED)  witii  a  video  camera,  or  di¬ 
rect-coupled  mechanical  linkages.  Only  the 
LED  method  offers  a  room-sized  movement 
space  today.  The  magnetic  and  mechanical 
trackers  are  limited  to  a  distance  of  a  few  feet. 
Accurate  and  rapid  tracking  of  head  position 
is  critical  to  maintaining  the  illusion  of  im- 
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VIRTUAL  INTERFACE  DESIGN  CONSTRAINTS 

Parameter 

Ideal 

Practical 

Visual  Display 

Fields  of  View 

120  Hx  70  V  deg 

100Hx60  Vdeg 

Angular  Activity 

1  min  of  arc 

5  min  of  arc 

Resolution 

7200  Hx  4200  V  pixels 

1200  H  X  720  V  pixels 

Refresh  Rate 

60  Hz 

60  Hz 

Bandwidth 

160,000  Mhz 

52  Mhz 

Head  Positioning 

Rotation  Velocity 

100  deg/sec 

50  deg/sec 

Rotation  Update  Rate 

6000  Hz 

600  Hz 

Translation  Update  Rate 

30  Hz 

20  Hz 

Throughput  Delay 

1  msec 

50  msec 

Figure  20.  Ideal  Interface  Parameters  Compared  to  Current  Practical  Limits 
(Source:  Dr.  Thomas  A.  Furness  Ill,  University  of  Washington) 


mersion  in  a  virtual  enviroirment  and  for 
avoiding  motion-induced  illness. 

A  wide  variety  of  head-mounted  displays 
have  been  developed  over  the  years  since 
Ivan  E.  Sutherland  created  the  first  device  in 
1965.^^  The  primary  technical  issues  to  be 
overcome  are  weight,  width  of  die  field  of 
view,  accuracy  of  the  head  positioning  sys¬ 
tem,  resolution  of  the  display  image  and  the 
rate  of  refreshing  the  display  image.  A  brief 
description  of  these  issues  follows  and  the 
quantitative  design  parameters  are  shown  in 
Figure  20.^^ 


—  Weight.  Excessive  weight  causes  users  fa¬ 
tigue.  If  the  center  of  gravity  is  not  posi¬ 
tioned  properly,  fatigue  is  increased  and 
motion-induced  illness  can  result.  The 
weight  of  die  display  causes  an  increase  in 
rotational  inertia  which  confuses  the  user's 
vestibular  system. 


— Field  of  View.  The  area  visible  without  mov¬ 
ing  the  head  is  the  field  of  view.  At  least  80 
degrees  of  horizontal  field  of  view  is  re¬ 
quired  to  give  an  impression  of  immersion 
and  avoid  a  timnel  vision  effect. 

—  Head  Position  Accurao).  The  head  position¬ 
ing  system  needs  to  detect  small  incre¬ 
ments  of  motion  and  update  the  display 
without  delay.  Systems  linked  to  head  posi¬ 
tioning,  such  as  weapon  sighting,  need  to 
be  coupled  accurately. 

—  Display  Resolution.  The  image  resolution 
should  be  7,200  pixels  horizontal  by  4,200 
pixels  vertical,  where  a  pixel  is  the  sir  Uest 
element  that  can  be  displayed.  Ma  t  h.  d- 
mounted  displays  today  fall  far  slioit  of 
this  goal. 

— Refresh  Rate.  The  display  image  must  be  up¬ 
dated  as  head  position  changes.  Computer 
hardware  and  software  performance  as 
well  as  head  positioning  accuracy  affects 
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the  refresh  rate.  Displays  which  lag  head 
movements  can  cause  illness. 

Examples  of  display  technologies  are: 

—  Dual  LED  displays  present  a  separate  im¬ 
age  to  each  eye,  augmented  by  optical 
lenses  to  increase  the  field  of  view.  Low 
cost  LED  display  technology  has  a  low 
resolution  of  about  700  by  300  pixels  today, 
but  higher  pixel  density  displays  are 
emerging. 

—  Dual  cathode-ray  tube  (CRT)  displays  offer 
higher  resolution,  but  are  monochrome. 
The  image  resolution  is  better  than  LED 
technology.  Full  color  miniature  CRTs  suit¬ 
able  for  head  mounting  are  not  readily 
available,  though  commercial  products  are 
anticipated  within  the  next  year. 

—  Dual  light  guns  with  fiber  optic  links  to  the 
head  mount  provide  color  displays  with  ac¬ 
ceptable  resolution.  Light  guns  are  high- 
intensity  image  projectors  that  cost  sub¬ 
stantially  more  than  other  display  tech¬ 
nologies.  The  resolution  of  the  display  is 
limited  by  the  size  and  number  of  optical 
fibers  that  conduct  the  image  to  the  head 
mounted  optics. 

—  Single  CRT  monochrome  displays  with 
shutter  lenses  alternately  present  a  slightly 
different  view  to  the  left  and  right  eye  to 
give  a  3D  image.  The  single  CRT  is  usually 
supported  by  a  counter-balanced  mechani¬ 
cal  boom  and  is  not  truly  a  head-mounted 
display. 

Two  new  ultra-light  weight  head-mounted 

monocular  displays  are  available  commer¬ 
cially: 

—  Private  Eye.  A  small  2-1 /4-ounce  display 
having  201,600  pixels  resolution  produces  a 
monochrome  red  image  on  a  black  badc- 


ground.  When  suspended  a  few  inches  in 
front  of  the  eye,  the  optics  produce  an  im¬ 
age  of  a  virtual  12-inch  display  three  feet 
from  the  viewer.  The  interface  is  compat¬ 
ible  with  the  International  Business  Ma¬ 
chines  Corporation  color  graphics  adapter 
(CGA)  standard.*® 

—  Virtual  Vision  Sport.  A  visor  supports  a 
small  reflecting  lens  which  produces  a 
96,6(X)  pixel  color  image  of  a  virtual  60-inch 
display  15  feet  in  the  distance.  The  visor 
weighs  five  ounces.  The  video  interface  is 
the  National  Television  Standards  Conven¬ 
tion  (NTSC),  common  in  the  United  States. 
A  beltpack  with  either  a  standard  US.  tele¬ 
vision  tuner  or  a  900-Mhz  receiver/ trans¬ 
mitter  is  available.  Stereo  earphones  arc 
also  mounted  on  the  visor.*^ 

SIMULATION  NETWORKING 
(SIMNET)  PROJECT 

The  SIMNET  is  a  joint  Army  and  ARPA  pro¬ 
ject  using  distributed  simulation  as  both  a 
prototype  training  device  and  a  new  technol¬ 
ogy  testbed  The  Army's  primary  use  focused 
on  training  collective  skills  of  crews  and  units 
using  low  cost  training  hardware  and  soft¬ 
ware.  The  ARPA  sought  to  use  new  technol¬ 
ogy  to  implement  a  distributed  simulation 
architecture  based  on  microprocessors,  local 
area  networks,  wide  area  networks,  new  com¬ 
puter  image  generators,  and  a  modular  struc¬ 
ture  that  would  facilitate  change. 

The  SIMNET  has  established  a  distributed  in¬ 
teractive  simulation  (DIS)  protocol  standard 
based  on  a  broadcast  scheme;  that  is,  each 
simulation  on  the  network  broadcasts  its  in¬ 
formation  to  all  other  participants.  Each  simu¬ 
lation  participant  is  autonomous  and 
responsible  for  maintaining  his/her  status, 
for  sending  messages  to  others,  and  for  inter¬ 
preting  and  responding  to  messages.  Figure 
21  shows  the  type  of  information  exchanged 
on  the  network.  Simulators  only  communi- 
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DIS  PROTOCOLS 

DIS  1.0  PDU 

DIS  2.0  PDU  (Proposed) 

Entity  State 

Emission 

Fire 

Laser 

Detonation 

Transmitter 

Service  Request 

Signal 

Resupply  Officer 

Instrumentation 

Resupply  Received 

Simulation  Management 

Resupply  Cancel 

Create  Entity 

Repair  Complete 

Remove  Entity 

Repair  Response 

Start/Resume 

Collision 

Stop/Freeze 

Acknowledge 

Action  Request 

Data  Query 

Set  Data 

Data 

Event 

Message 

DIS  =  Distributed  interactive  Simulation 

PDU  =  Protocol  Data  Unit 

Figure  21.  SIMNET  Information  Exchange  (Source;  STRICOM) 


cate  changes  in  the  world  state.  A  dead  reck¬ 
oning  technique  is  used  to  reduce  message 
traffic  on  the  network.  Each  simulator  keeps  a 
simplified  model  of  the  state  of  all  other  par¬ 
ticipants  within  its  area  of  interest.  Last  re¬ 
ported  states  are  extrapolated  until  a  new 
update  arrives.  Each  simulator  also  maintains 
a  dead  reckoning  model  of  itself  and  broad¬ 
casts  an  update  whenever  its  state  diveiges  a 
set  amotmt  from  the  extrapolation.  The  mini¬ 
mum  update  interval  is  1/15  of  a  second  and 
a  maximum  of  five  seconds.^^  The  SIMNET 
messages  are  called  Protocol  Data  Units 
(PDU)  and  the  PDU  structure  is  independent 
of  the  type  of  network  being  used. 


The  STRICOM,  with  DMSO  and  the  Institute 
of  Simulation  and  Training  at  the  University 
of  Central  Florida,  is  responsible  for  manag¬ 
ing  the  combined  workshops  for  developing 
the  technical  standards  for  DIS.  Repre¬ 
sentatives  from  the  Army,  Navy,  Marines,  Air 
Force,  other  government  agencies,  industry 
and  academia  are  participating  in  the  DIS  de¬ 
velopment. 

The  SIMNET  has  evolved  from  use  as  a  train¬ 
ing  device  to  a  means  for  evaluating  acquisi¬ 
tion  alternatives.  It  can  be  used  to  study 
future  concepts,  vehicles,  weapons,  tactics, 
procedures  and  doctrine. 
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PHASE  1  BDS-D  GOALS 

Operational  Capability 

Current  Baseline 

Environmental  Effects: 

Day/Night 

Day  only 

Obscurants 

None 

Weather 

None 

Terrain: 

150  X  300  Km  area 

50  X  70  Km  area 

Changeable  Cultural  Features 

Fixed 

Dynamic  Terrain 

Fixed 

Trafiicability 

None 

Improved  Fidelity 

Marginal 

Signatures: 

Thermal,  4  Levels 

Very  limited 

Electromagnetic  Emitters 

None 

Force  Representation: 

Crewed  Simulators,  8  Level  II 

20  Level  I 

80%  Software  Reconfigurable 

Fixed  design 

Semiautomated  Forces,  80  Level  II 

15  Level  1  work 

workstations  per  operator 

workstations  per  operator 

Air  Defense,  Indirect  Fire, 

None 

Electronic  Warfare 

Systems  Architecture: 

DIS  Standard  2.0 

DIS  Standard  1.0 

Validated  Models 

Nonvalidated 

Configuration  Managed  Documentation 

Incomplete  Documentation 

Mixed  LANs 

Identical  LANs 

Security: 

Secret 

Figure  22.  BDS-D  Capabilities  Compared  to  SIMNET  (Source:  STRICOM) 
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BATTLEFIELD  DISTRIBUTED 
SIMULATION-DEVELOPMENT  (BDS-D) 
The  BDS-D  is  a  follow-on  development  net¬ 
work  based  on  SIMNET  success.  The  BDS-D 
will  focus  on  providing  a  warfighting  assess¬ 
ment  capability  network  using  a  soldier-in- 
the-loop  virtual  reality  approach.  Two  major 
issues  addressed  by  BDS-D  are  the: 

—  Verification,  validation  and  accreditation  of 
the  DIS  models 

—  DOD  and  industry  standards  and  protocols 
used  for  the  DIS  architecture. 

If  DIS  is  to  be  used  to  make  acquisition  deci¬ 
sions,  the  elements  of  the  network  must  pro¬ 
vide  an  environment  accurate  enough  that 
simulation  results  can  be  used  with  confi¬ 
dence.  This  means  verification  and  validation 


should  be  accomplished  at  the  major  com¬ 
mand  level  within  the  Army  and  accredita¬ 
tion  should  be  at  the  Army  staff  level.  The 
U.S.  Army  Training  and  Doctrine  Command 
(TRAEXXI)  may  provide  the  combat  develop¬ 
ment  requirements  and  the  Army  Materiel 
Command  can  provide  the  acquisition  re¬ 
quirements  to  form  an  accurate  and  accept¬ 
able  simulation  environment. 

The  BDS-D  plans  to  link  government,  indus¬ 
try  and  academic  facilities  together  using  an 
object-oriented  distributed  system  with 
standards  derived  from  SIMNET.  In  Phase  I 
of  BDS-D  (FY  1992-94)  a  number  of  advances 
over  SIMNET  capability  are  planned.  See  Fig¬ 
ure  22.  Increased  fidelity  of  the  simulation 
battlefield  is  required  to  support  acquisition 
decisions. 
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X  rays  are  a  hoax. 

—  Lord  Kelvin,  ca.  1880 


Chapter  4 

SYNTHETIC  ENVIRONMENTS 
IN  ACQUISITION 


In  previous  chapters,  we  summarized  the 
defense  acquisition  environment  and  de¬ 
scribed  virtual  prototyping  tools.  This  re¬ 
port  now  presents,  in  detail,  how  these  tools 
can  be  used  in  defense  acquisition.  In  this 
chapter,  we  start  with  a  synopsis  of  the  acqui¬ 
sition  process  delineated  in  DOD  Directive 
(DODD)  5000.1  and  DOD  Instruction  (DODD 
5(XX)J2.  We  identify  and  discuss  the  two  policy 
areas  where  virtual  prototyping  offers  the 
greatest  promise  —  translating  operational 
needs  into  stable,  affordable  programs  and  ac¬ 
quiring  qutility  products.  We  then  discuss  the 
possible  use  of  advanced  simulation  in  a  wide 
range  of  applications  including  analysis  of 
campaign  and  force  structure,  system  advo¬ 
cacy,  configuration  determination,  trade-off 
studies,  cost  analysis,  engineering  design  sup¬ 
port,  testing  and  evaluation,  development 
and  operational  test  design,  excursion  and 
sensitivity  analysis,  and  production  and  logis¬ 
tics.  Our  purpose  is  to  describe  current  and 
potential  applications  in  each  of  these  areas. 
Our  intent  is  to  help  program  managers 
(PMs)  who  want  to  capitalize  on  the  advan¬ 
tages  of  advanced  simulation  to  help  manage 
their  programs  and  policy  makers  attempting 
to  irrfluence  the  future  direction  of  simulation 
and  virtual  prototyping. 

THE  ACQUISITION  PROCESS 
To  better  appreciate  th'  current  and  potential 
future  impacts  of  virb  prototypes  on  the  ac¬ 
quisition  process,  the  following  synopsis  from 


DODD  5000.1 /DODI  5000.2  is  provided  to  re¬ 
fresh  the  reader's  awareness  of  current  acqui¬ 
sition  policy.  Policies  not  germane  to  the  use 
or  impact  of  virtual  prototypes  have  not  been 
included  in  this  summary. 

Policies  and  Procedures 
The  DOD  is  the  largest  purchaser  of  supplies 
and  services  in  the  federal  government  In  the 
past,  numerous  regulations,  directives.  Serv¬ 
ice-unique  supplements,  etc.,  have  been  is¬ 
sued  to  provide  guidance  to  the  various  EXDD 
acquisition  commimities.  Unfortunately,  there 
was  great  duplication  and  often  somewhat 
confusing  and  conflicting  guidance  between 
these  numerous  documents.  Thus,  the  "acqui¬ 
sition  system"  became  part  of  the  problem  in¬ 
stead  of  a  solution  to  ongoing  attempts  by 
DOD  to  optimize  the  return  for  its  acquisition 
dollars.  In  early  1991,  the  Deputy  Secretary  of 
Defense  issued  a  new  directive  to  attack  this 
problem.  The  DODD  5000.1,  "Defeirse  Acqui¬ 
sition,"  dated  23  February  1991,  replaced  the 
previous  version,  "Major  and  Non-Major  De¬ 
fense  Acquisition  Programs."  It  also  replaced 
DODD  4245.1,  "Military  Department  Acquisi¬ 
tion  Management  Officials"  and  canceled 
more  than  60  previously-issued  DOD  acquisi¬ 
tion  directives,  instructions  and  memoran- 
dutirs.  The  stated  purpose  of  the  new 
directive  is  to  establish  "a  disciplined  man¬ 
agement  approach  for  acquiring  systems  and 
materiel  that  satisfy  the  operational  user's 
needs."'  The  new  acquisition  policies  set  forth 
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in  this  document  are  intended  to  "establish  a 
disciplined  approach  for  integrating  the  ef¬ 
forts  and  products  of  the  EKDEXs  requirements 
generation;  acquisition  management;  and 
planning,  programming  and  budgeting  sys¬ 
tems."^  Figure  23  graphically  illustrate^  these 
key  interactions. 

This  disciplined  approach  is  designed  to  pro¬ 
vide  a  method  to  translate  operational  needs 
into  stable,  affordable  programs  that  acquire 
only  quality  products.  The  directive  man¬ 
dated  a  new  streamlined  acquisition  manage¬ 
ment  structure  to  be  organized  for  efficiency 
and  effectiveness.  It  requires  PMs  assigned  to 
manage  major  defense  acquisition  programs 
to  report  througli  Program  Executive  Officers 
to  the  OOD  Component  Acquisition  Execu¬ 
tive  or  directly  to  the  DOD  Acquisition  Execu¬ 
tive,  when  warranted. 

Subjects  covered  by  the  more  than  60  docu¬ 
ments  superseded  by  DODD  5000.1  were  con¬ 


solidated  and  simultaneously  replaced  by  a 
new  DODl  5000.2,  "Defense  Acquisition  Man¬ 
agement  Policies  and  Procedures."  This  In¬ 
struction  reissued  Instruction  5000.2  and 
authorized  the  Under  Secretary  of  Defense 
(Acquisition  and  Technology)  (USEHA&T)), 
(formerly  the  Under  Secretary  of  Defense  (Ac¬ 
quisition))  to  publish  DOD  5000.2-M, 
"Defense  Acquisition  Management  Documen¬ 
tation  and  Reports,"  in  accordance  with  DOD 
5025.1-M,  "Department  of  Defense  Directive 
System  Procedures."  The  stated  purpose  of 
DODI  5000.2  is  to  establish: 

—  An  integrated  framework  for  translating 
broadly  stated  mission  needs  into  stable,  af¬ 
fordable  acquisition  programs  that  meet 
the  operational  user's  needs  and  can  be 
sustained,  given  projected  resource  con¬ 
straints;  and, 

—  A  rigorous,  event-oriented  management 
process  for  acquiring  quality  products  that 
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Figure  24.  Acquisition  Phases  and  Milestone  Decision  Points 


emphasizes  effective  acquisition  planning, 
improved  communications  with  users,  and 
aggressive  risk  management  by  both  gov¬ 
ernment  and  industry? 

By  issuing  DODD  5000.1  and  DODl  5000.2, 
the  DOD  has  established  a  core  of  fundamen¬ 
tal  policies  and  procedures  that  can  be  imple¬ 
mented  down  to  the  PM  and  field  operating 
command  level  wittiout  supplementation.  In¬ 
creased  efficiency  and  effectiveness  will  be 
achieved  through  an  acquisition  management 
structure  that  has  been  streamlined  by  estab¬ 
lishing  short,  clearly  defined  lines  of  responsi¬ 
bility,  authority  and  aocoimtability. 

From  program  inception  through  the  fielding 
process,  the  PM  is  required  to  develop  and 
keep  current  the  acquisition  strategy  for  the 
program.  The  acquisition  strategy  is  tire  over¬ 


all  road  map  for  the  program  and  is  reflected 
in  the  detailed  plans  the  PM  uses  for  program 
management.  At  each  milestone  (MS)  deci¬ 
sion  point,  a  synthesis  of  these  program 
plans,  along  with  the  essential  information 
needed  to  comply  with  statutorily  imposed 
requirements  and  make  dedsioits,  is  provided 
by  the  PM  to  the  MS  decision  authority.  The 
PM  must  provide  the  MS  decision  authority 
with  periodic  assessment  reports  during  the 
execution  of  the  program  between  MSs.  These 
assessment  reports  must  address  the  status  of 
program  accomplishments  against  program 
plans  and  baselines  for  that  phase  of  the  pro¬ 
gram.  The  chart  shown  in  Figure  24  illustrates 
the  over-arching  acquisition  strategy  and  the 
relationship  of  the  program  plans,  milestone 
documentation  and  periodic  reports.^  Re¬ 
quirements  documents,  the  Integrated  Pro¬ 
gram  Summary  (IPS)  with  annexes  and 
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Figure  25.  Milestone  Documentation  Concept 


stand-alone  documents  are  the  three  general 
document  categories  for  an  M5  review.  Infor¬ 
mation  provided  in  the  IPS  and  stand-alone 
documents  provide  the  staff  witti  the  infor¬ 
mation  needed  to  develop  the  Integrated  Pro¬ 
gram  Assessment  and  enable  the  MS  decision 
authority  to  make  an  MS  decision.  The  MS 
documentation  concept  in  Figure  25  shows 
the  types  of  information  included  in  each 
category. 

Part  1  of  DODD  5000.1  contains  acquisition 
policies  designed  to  provide  a  means  for 
translating  operational  needs  into  stable,  af¬ 
fordable  programs  that  acquire  quality  prod¬ 
ucts.  The  following  two  sections  contain 
policies  from  DODD  5000.1  that  are  key  to  un- 
deistanding  the  subject  of  this  report^ 


TRANSLATING  OPERATIONAL  NEEDS 
Evolutionary  Requirements  Definition 
Mission  needs  must  be  expressed  by  the  user 
commimity  in  broad  operational  capability 
terms,  and  nonmateriel  solutions  such  as  a 
change  in  doctrine  must  be  considered  before 
proceeding  with  an  acquisition  program.^  Fig¬ 
ure  26  provides  an  overview  of  the  stepw  in¬ 
volved  in  processing  a  Mission  Need 
Statement  (MNS). 

The  Joint  Requirements  Oversight  Council 
decides  if  the  mission  cannot  be  satisfied  by  a 
nonmateriel  solution,  "validates"  the  need, 
assigns  a  joint  priority,  and  forwards  it  to  the 
USD(A&T).  The  Under  Secretary  convenes  a 
Defeirse  Acqi  n  Board  (DAB)  to  review 
the  MNS.  TI  jw  and  decision  point  is 
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Figure  26.  Mission  Need  Statement  Flow 


called  Milestone  0,  Concept  Stud  pproval, 

and  it  establishes  the  initial  ini  >etween 

the  requirements  generation  an  acquisi¬ 

tion  system.  Favorable  action  by  the  DAB  is 
documented  by  an  Acquisition  Decision 
Meimrandum  that 

—  Directs  studies  of  a  minimum  set  of  ma te¬ 
nt  1  alternatives; 

—  Designates  a  lead  department  or  agency  to 
conduct  the  studies  and  present  the  results 
at  the  next  milestone  review;  and, 

—  Identifies  a  source  of  funds  for  the  studies.^ 

MILESTONES  AND  PHASES 
The  acquisition  process  is  structured  in  dis¬ 
crete,  logical  phases,  separated  by  major  deci¬ 


sion  points  or  MSs."  As  Figure  27  indicates, 
there  are  five  major  MS  decision  points  and 
five  distinct  phases  in  the  acquisition  process. 

The  sequential  process  indicated  by  the  dia¬ 
gram  provides  a  basis  for  comprehensive 
management  and  supports  the  progressive 
decision  making  process  associated  with  pro¬ 
gram  maturation.’ 

Major  considerations  at  each  decision  point 
shall  include  threat  projections,  life-cycle 
costs,  cost-performance-schedule  trade-offs, 
affordability  constraints,  and  risk  manage¬ 
ment.  Acquisition  program  MS  decision 
authority  shall  be  delegated  to  the  lowest 
level  deemed  appropriate  by  the  USD(A&T) 
or  the  DOD  Component  Head,  as  appropri- 
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At  MS  I,  Concept  Demonstration  Approval, 
the  results  of  the  studies  are  evaluated  and 
the  acquisition  strategy  and  proposed  concept 
in  terms  of  cost,  sdtedule  and  performance 
objectives  are  weighed  against  projected 
funding  availability. 

Approval  at  MS  I  marks  the  start  of  a  new  ac¬ 
quisition  program.  Once  a  "new  start"  has 
been  approved,  the  broad  operational  capabil¬ 
ity  requirements  must  progressively  evolve  to 
system-specific  performance  requirements 
such  as  speed,  range,  payload,  etc.  Validated 
intelligence  threat  assessments  must  be  used 
to  ensure  the  system  being  developed  is  mis¬ 
sion  capable  in  its  intended  operational  envi- 
rorunent”  Figure  28  depicts  the  evolutionary 
requirements  definition  process  and  its  rela¬ 
tionship  to  the  requirements  generation  and 
acquisition  management  systems.'^ 

ACQUIRING  QUALITY  PRODUCTS 
To  acquire  quality  products,  effective  acquisi¬ 
tion  planning  and  aggressive  risk  manage¬ 
ment  by  government  and  industry  are 
essential  for  success.  Program  decisions  and 
resource  conunitments  must  be  based  on 
plans  for,  and  progress  in,  controlling  risk. 


Acquisition  Strategies,  Exit  Criteria  and 
Ri^  Management 

Primary  in  developing  an  acquisition  strategy 
is  minimizing  the  time  it  lakes  to  satisfy  an 
identified  need  consistent  with  common 
sense,  sound  business  practice,  and  die  provi¬ 
sions  of  DODD  5000.1  and  DODI  5000.2.  The 
number  of  phases  and  decision  points  must 
be  tailored  to  meet  the  specific  needs  of  indi¬ 
vidual  programs.  The  tailoring  must  be  based 
on  an  objective  assessment  of  a  program's 
status,  risks,  and  the  adequacy  of  proposed 
risk  management  plans.’^  Acquisition  strate¬ 
gies  and  program  plans  will  be  event-driven 
and  explicitly  link  major  contractual  commit¬ 
ments  and  MS  decisions  to  demonstrated  ac¬ 
complishments  in  development,  testing  and 
initial  production.  At  each  MS  dedoion  point, 
assessments  will  be  made  of  the  status  of  pro¬ 
gram  execution  and  the  plans  for  the  next 
phase  and  the  remainder  of  the  program.  Pro¬ 
gram  specific  results  to  be  required  in  the  next 
phase,  called  exit  criteria,  are  also  established. 

Exit  criteria  are  critical  results  that  can  be 
viewed  as  gates  through  which  a  program 
must  pass  during  the  phase.  Two  examples  of 
exit  criteria  are:' 
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Figure  28.  Evolutionary  Definition  Requirements  Process 
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Figure  29.  Acquisition  Phases  and  Milestone  Decision  Points 


—  Achieve  a  specified  level  of  performance  in 
testing  or  conduct  a  critical  design  review 
prior  to  committing  funds  for  long  lead 
item  procurement. 

—  Demonstrate  the  adequacy  of  a  new  manu¬ 
facturing  process  prior  to  entry  into  low- 
rate  initial  production. 

Program  plans  provide  for  a  systems  engi¬ 
neering  approach  to  the  simultaneous  design 
of  the  product  and  its  associated  manufactur¬ 
ing,  test  and  support  processes.  This  concur¬ 
rent  engineering  approach  is  essential  to 
achieving  a  careful  balance  among  system  de¬ 
sign  requirements  such  as  operational  per¬ 
formance,  producibility,  reliability,  logistics 
and  human  engineering.’^ 

The  DODI 50002,  Part  6,  sets  forth  a  group  of 
policies  and  procedures  establishing  a  com¬ 
mon  frame  of  reference  for  developing  plans 


in  engineering  and  manufacturing.  Systems 
engineering,  reliability  and  maintainability, 
transportability,  human  factors,  computer- 
aided  acquisition  and  logistics  support 
(CALS),  and  design  for  manufacturing  and 
production  are  all  areas  that  could  be  affected 
by  virtual  prototypes. 

Program  risk  must  be  explicitly  assessed  at 
each  MS  decision  jx)int  before  granting  ap¬ 
proval  to  proceed  to  the  next  acquisition 
phase.  Figure  29  illustrates  tiiis  process. 

Critical  parameters  that  are  design  cost  driv¬ 
ers  or  have  a  significant  impact  on  readiness, 
capability  and  life-cycle  costs  must  be  identi¬ 
fied  early  and  managed  intensively.  Tech¬ 
nology  demonstrations  and  aggressive  proto¬ 
typing  (including  manufacturing  processes, 
hardware  and  software  systems  and  critical 
subsystems),  coupled  with  early  operational 
assessments,  are  to  be  used  to  reduce  risk. 
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Determination  of  system  maturity  and  identi¬ 
fication  of  technical  risk  areas  is  accomplished 
through  test  and  evaluation.  Requests  for  Pro¬ 
posal  require  contractors  to  identify  areas  of 
risk  and  provide  specific  plans  to  assess  and 
eliminate  risks  or  reduce  them  to  acceptable 
levels.  At  each  MS  decision  point,  the  follow¬ 
ing  risk  areas  must  be  assessed;** 

—  Threat,  technology,  design  and  engineering, 
support,  manufacturing,  cost  and  schedule 

—  Risks  inherent  in  the  proposed  degree  of 
concurrency. 

Program  Objectives  and  Baselines 
At  the  new  start,  MS  decision  broad  objectives 
for  cost,  schedule  and  performance  parame¬ 
ters  are  established.  These  peirameters  are  re¬ 
viewed  and  refined  at  eadh  subsequent  MS 
decision  and  are  the  basis  for  the  program 
baselines.  The  selected  performance  objec¬ 
tives  must  satisfy  operational  needs  specified 
by  the  user  and  must  be  verifiable  by  test¬ 
ing.'^  In  the  following  discussion,  we  examine 
the  use  of  virtual  prototyjjes  and  how  they 
might  impact  the  attainment  of  cost,  schedule 
and  performance  parameters.  The  discussion 
is  segregated  into  the  five  functional  sub¬ 
groups  involved  in  the  acquisition  process. 

ANALYSIS 

The  collapse  of  the  Soviet  Union  eliminated 
the  threat  of  a  large-scale  struggle  for  national 
survival.  As  a  result,  our  defense  and  acquisi¬ 
tion  strategies  have  been  revised  to  focus  on  a 
world  that  may  erupt  in  one  or  more  regional 
conflicts.  Strategic  deterrence  is  still  impor¬ 
tant  but  force  structure  must  be  changed  to 
accommodate  the  increased  emphasis  on 
power  projection  necessary  to  adequately  ad¬ 
dress  the  wide  spectrum  of  options  required 
in  regional  conflicts. 

Civilian  evacuation,  surgical  strikes, 
peacekeeping  activities,  forcible  entry  up  to 


and  including  full-scale  war  are  examples  of 
the  wide  range  of  scenarios  facing  our  mili¬ 
tary  services. 

The  new  DOD  acquisition  strategy  establishes 
the  framework  for  continuously  demonstrat¬ 
ing  technology  to  provide  technology  options 
for  force  planners  and  defense  decision  mak¬ 
ers.  If  the  new  capability  (component,  subsys¬ 
tem,  system,  etc.)  successfully  influences  the 
outcome  of  the  mission,  a  decision  will  be 
made  to  either  upgrade  exishng  systems 
through  incorporation  of  the  technology  or  to 
begin  development  of  an  entirely  new  system 
based  on  this  new  capability.  But  how  do  we 
demonstrate  new  capabilities  when  the  force 
structure  and  the  DOD  acquisition  budget  are 
being  reduced  dramatically?  Breakthroughs 
in  advanced  simulation  technology  have  the 
potential  to  allow  DOD  to  accomplish  this 
challenging  task  and  to  improve  weapon  sys¬ 
tem  procurement  dramatically.  The  following 
sections  address  using  virtual  prototypes  in 
synthetic  environments  for  campaign  analysis 
and  force  structure  assessment. 

Campaign  Analysis 

Campaign  analysis  involves  evaluating  the 
interaction  of  one  or  more  large  friendly 
forces  and  an  enemy  force.  Emphasis  is  on  en¬ 
hancing  the  adecjuacy  of  the  models  used  in 
campaign  analysis  to  better  represent  the  con¬ 
duct  of  joint  and  combined  operations.  A 1988 
Army  Science  Board  report  states: 

Waigame  models  are  best  used  in  broad 
identification  of  issues  and  development 
of  insights.  Watgame  models...should 
not  be  used  for  the  evaluation  of  alterna¬ 
tive  solutions  or  sensitivity  analyses. 

The  report  further  recommended  replacing 
the  assessment  routines  in  training  models 
with  those  used  in  analysis  models.  The  data 
used  in  these  assessment  routines,  to  the 
maximum  extent  possible,  should  be  measur- 
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able  data  generated  by  Army  and  Air  Force 
laboratories.  According  to  the  Science  Board, 
major  disparities  exist  in  the  assumptions, 
employment  logic  and  assessment  routines 
used  by  the  Services  in  their  respective  carrv- 
paign  models  and  a  program  should  be  devel¬ 
oped  to  resolve  these  differences.'® 

As  discussed  in  this  report  re<ilistic  virtual 
prototypes  with  man-in-the-loop  operation 
have  b^n  developed  for  individual  weapon 
systems.  Multiples  of  certain  prototypes  have 
been  electronically  coupled  to  allow  battle¬ 
field  scenarios  participation  in  limited  size 
and  duration.  Because  campeiign  analysis 
usually  involves  the  interaction  of  large  forces 
over  extended  periods  of  time,  the  modeling 
done  for  one  item  of  equipment  (one  M-1 
tank,  F-16  aircraft,  etc)  within  the  overall 
force  structure  is  usually  limited,  if  modeled 
at  all.  A  single  strategic  platform  may  involve 
more  extensive  modeling  but  even  this  effort 
is  not  one  that  includes  an  operator-in-the- 
loop  during  the  exercise  of  the  model.  Be¬ 
cause  of  tire  nature  of  campaign  analysis,  it 
does  not  seem  the  use  of  a  manned  virtual 
prototype  would  have  any  benefit.  Modeling 
and  simulation  in  general,  however,  have  an 
application  in  campaign  analysis.  Future  ex¬ 
pectation  is  campaign  analysis  models  will  be 
able  to  furnish  senior  defense  officials  wiflr  a 
tool  for  budget  deliberations  relating  indi¬ 
vidual  system  effectiveness  to  the  predicted 
outcome  of  military  campaigns.'^  We  had  no 
opportunity  to  research  this  specific  type  of 
analysis;  thus,  our  assessment  may  warrant 
furtiier  review. 

Force  Structure  Assessment 
Warfighting  concepts  to  meet  changing  world 
realities  are  in  a  period  of  reassessment.  A 
specific  threat  is  no  longer  the  basis  for  an  ac¬ 
quisition  requirement.  The  DOD  is  focusing 
on  capabilities  and  how  each  might  influence 
the  outcome  of  a  specific  scenario  (regiortal 
conflict  in  Country  X,  surgical  strike  in  Covm- 


try  Y).  A  key  part  of  each  evaluation  is  the  size 
and  skill  level  of  the  force  structure  required 
to  accomplish  each  mission.  Synthetic  envi- 
rorunents  employing  different  weapon  sys¬ 
tems  and  different  force  structures  permit 
DOD  war  planners  and  higher  level  decision 
nrakers  to  evaluate  the  impact  of  changing  the 
types  ind  numbers  of  weapon  systems  and 
their  respective  crews  and  support  structures. 
Irrherent  in  these  ongoing  synthetic  force-on- 
force  evaluations  is  the  opportunity  to  insert  a 
new  capability  via  a  virtual  prototype  and 
evaluate  its  impact.  The  virtual  prototype  can 
be  represented  at  any  hardware  level  in  the 
evaluation;  i.e.,  a  new  radar  in  an  existing 
fighter  or  helicopter,  a  new  missile  mounted 
on  a  tarrk,  or  a  totally  new  weapon  concept  If 
the  new  capability  provides  a  signiffcant  force 
multiplier  to  the  unit,  reducing  unit  size  or 
numl^rs  may  be  possible  while  maintaining 
an  acceptable  level  of  combat  performance. 
Similarly,  virtual  prototypes  can  facilitate  op¬ 
erator  workload  assessments  associated  with 
the  introduction  of  a  new  capability.  If  the 
new  integrated  sensor  suite  being  evaluated 
involves  extensive  automation  and  littie  or  no 
operator  input,  perhaps  a  smaller  crew  can 
operate  the  new  weapon  system  platform.  Al¬ 
ternatively,  because  of  reduced  workload,  the 
original  crew  can  now  execute  its  mission 
more  effectively  (identify  and  kill  more  tar¬ 
gets)  and,  thus,  fewer  weapon  systems  are  re¬ 
quited.  The  Army  used  a  virtual  prototype  of 
the  Comanche  built  by  Sikorsky  for  assistance 
in  confirming  the  proper  crew  size  and  re¬ 
spective  functional  assignments  within  the 
cockpit®  The  "electronic  battiefield"  created 
via  distributed  interactive  simulation  will  al¬ 
low  DOD  decision  makers  to  evaluate 
weapon  systems  and  force  structures  on  an 
interactive  basis  to  determine  the  optimum 
mix  for  future  conflicts. 

SYSTEM  ADVOCACY 

In  the  early  stages  of  any  new  weapon  system 

development,  the  user  and  the  developer  are 
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confronted  with  a  problem  —  how  to  develop 
a  constituency  willing  to  support  and  fund 
the  new  system.  The  sphere  of  system  advo¬ 
cacy  must  be  expanded  from  its  initial  set  of 
users  and  developers  to  the  larger  Service  and 
congressional  environment.  For  example,  the 
aviation  community  may  have  to  convince 
the  armor  community  that  a  new  helicopter  is 
the  most  critical  component  for  a  combined 
arms  team.  In  the  past,  each  weapon  system 
proponent  based  the  need  for  a  new  system  on 
the  evolving  capabilities  of  a  similar  threat 
system.  Snce  the  DOD  budget  in  the  198Qs 
was  sufficient  to  permit  an  aviation  develop¬ 
ment  and  an  armor  development  at  the  same 
time,  the  "advocacy"  issue  was  usucilly  lim¬ 
ited  to  one  where  other  fun-'honal  areas  ac¬ 
knowledged  and  agreed  the  new  system  had 
merit.  Obviously,  each  Service  had  to  justify 
its  programs  in  the  annual  budget  battle  and 
provide  support  to  DOD  in  justifying  its 
budget  to  Congress.  System  advocacy  was 
normally  developed  through  a  continuing  se¬ 
ries  of  individual  Service  and  contractor  brief¬ 
ings.  Color  viewgraphs  and  artists  concepts 
were  the  primary  means  of  visualizing  the 
new  weajKin  system  at  these  sessions  and 
rarely  did  they  address  the  capabilities  of 
other  new  systems. 

Those  days  are  gone!  As  described  in  Chapter 
2,  the  DOD  budget  has  been  dramatically  re¬ 
duced  and  these  reductions  will  continue  in 
the  foreseeable  future.  Each  Service  is  "down¬ 
sizing"  in  accordance  with  the  FY  1993  guid¬ 
ance  and,  at  the  same  time,  internal  and 
external  reviews  are  being  conducted  to  de¬ 
termine  if  the  roles  and  missions  of  each  Ser¬ 
vice  (per  the  1947  Key  West  agreement)  are 
still  valid.  The  primary  ttirust  is  to  reduce  any 
overlap  of  capability  among  the  Services;  the 
obvious  goal  is  to  further  reduce  equipment 
and  manpower.  In  this  new  lean  environment, 
obtaining  system  advocacy  has  taken  on  a 
much  broader  and  potentially  more  crucial 
meaning.  The  system  proponent  must  now 


convince  its  functional  area  constituents  and 
attempt  also  to  establish  in  the  same  Service 
at  least  a  neutral  ground  with  other  functional 
areas  competing  for  their  share  of  cm  ever-de¬ 
creasing  budget.  This  competition  for  funds  is 
best  characterized  as  survival  of  the  fittest 
and  advocacy  of  the  system  by  components 
other  than  the  developer  is  essential  in  to¬ 
day's  environment.  The  ability  to  demon¬ 
strate  the  "value-added"  capabilities  of  a  new 
system  while  at  the  same  time  convincing  the 
audience  the  technical  and  financial  risks  as¬ 
sociated  with  obtaining  this  capability  are  rei 
sonable  is  essential  in  this  multilayered  funus 
competition.  Many  skills  associated  with  pro¬ 
fessional  marketing  are  becoming  an  essential 
ingredient  in  this  new  environment. 

Basic  marketing  research  indicates  that  gain¬ 
ing  support  for  a  new  product  is  facilitated  by 
pictures  of  the  item  and  more  so  by  a  sample 
or  model.  Our  research  has  indicated  the  use 
of  a  virtual  prototype  can  positively  influence 
product  support  (system  advocacy  in  DOD 
terminology)  at  all  levels  of  the  acquisition 
process.  Because  of  the  benefits  of  3-D  visuali¬ 
zation,  the  virtual  prototype  facilitates  intro¬ 
duction  of  a  new  weapon  system  concept  and 
increases  user  involvement  in  the  develop¬ 
ment  process  by  providing  a  better  means  for 
earlier  and  more  productive  user  and  devel¬ 
oper  commimication.  High  user  interest  is 
maintained  primarily  because  the  virtual  pro¬ 
totype  can  accommodate  rapidly  incorporat¬ 
ing  suggested  user  changes  to  the  design.  The 
ability  to  evaluate  multiple  options  with  the 
user  community  is  key  to  developing  a  user 
sense  of  ownership  which  is  essential  for  sys¬ 
tem  advocacy.  The  same  3D  visualization 
portrayed  to  the  user  is  a  primary  ingredient 
in  building  system  advocacy  throughout  the 
acquisition  community.  Having  a  virtual  pro- 
totyqre  available  to  demonstrate  to  technical 
and  budgetary  decision  makers  has  tremen¬ 
dous  potential  for  assisting  the  developer  in 
convincing  the  audience  that  program  risk  is 
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Figure  30.  Artist  Visualization  of  RAH-66  Comanche  Virtual  Prototype 


being  reduced.  This  is  especially  true  for  vir¬ 
tual  prototypes  produced  on  computer  sys¬ 
tems  that  are  coupled  to  the  computer-based 
engineering  drawing  and  manufacturing  sys¬ 
tems.  A  digital  model  that  can  be  rotated  and 
examined  from  all  angles,  including  a  view 
from  the  inside,  is  more  believable  than  a 
three-foot  stadc  of  viewgraphs  containing  2-D 
drawings.  Figures  30, 31  and  32  are  examples 
of  virtual  prototypes  developed  for  Army,  Air 
Force  and  Navy  programs.  They  illustrate 
graphically  the  power  of  3-D  visualization. 

The  Boeing  Sikorsky  RAH-66  Comanche  team 
has  made  extensive  use  of  its  virtual  proto¬ 
type  in  winning  the  Army's  newest  and  laig- 
est  aviation  program.  System  advocacy  was 
enhanced  by  better  user  interface  with  the 
contractor  design  team  and  active  Army  test 
pilots  actually  fkw  the  virtual  prototype  dur¬ 
ing  the  Concept  Development  Phase  of  the 


program.  Insights  gained  from  these  flights 
coupled  with  other  contractual  information 
have  permitted  the  Army  to  down  select  to 
one  source  for  the  follow-on  Engineering  and 
Manufacturing  Development  Phase  of  the 
program. 

The  Electric  Boat  Division  of  General  Dynam¬ 
ics  also  is  using  their  virtual  prototype  of  the 
next  generation  submarine,  the  Centurion,  to 
build  system  advocacy  during  the  infancy  of 
this  emerging  program.  As  illustrated  by  Fig¬ 
ure  31,  the  ability  to  graphically  represent 
their  concept  in  a  computer  generated  3-D 
solid  model  is  a  powerful  marketing  and  de¬ 
sign  tool.  Development  of  system  advocacy 
will  certainly  be  facilitated  by  Electric  Boat's 
capability  to  allow  future  users  as  well  as 
DOD  and  congressional  decision  makers  to 
"walk  through"  the  new  Centurion  and  thus 
gain  a  multidimensional  appreciation  for  the 
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Figure  31.  Computer-Generated  3-D  Model  of  Centurion  Submarine  Protoype 


Figure  32.  F-22  Aircraft  Prototype 
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Figure  33.  TRW's  Design  for  Brilliant  Eyes  Satellite 


viability  of  their  concept  During  our  visit  to 
their  facility  we  were  given  the  opportunity  to 
experience  their  visualization  techniques  and 
facilities.  As  hard  as  it  may  seem,  three  offi¬ 
cers  from  non-Navy  Services  began  to  believe 
in  fiieir  approach. 

Virtual  prototypes  are  being  used  by  Boeing 
on  both  Air  Force  and  commercial  programs. 
Figure  32  is  a  model  of  the  new  F-22  being  de¬ 
veloped  utilizing  this  process.  The  dimen¬ 
sions  from  the  virtual  prototype  have  been 
electronically  transferred  to  a  stereo  lifliogra- 
phy  machine  that  produced  this  scale  model. 

Boeing  also  has  made  the  corporate  decision 
to  use  virtual  prototypes  in  commercial  air¬ 
craft  design  and  fabrication.  The  world's  laig- 
est  builder  of  aircraft  believes  this  technology 
will  enable  them  to  develop  the  necessary 
system  advocacy  among  their  commerdai 
customers  to  remain  number  one  in  the  21st 


century.  Today,  they  use  their  virtual  proto- 
tjpe  in  the  design  and  fabrication  of  their 
next  generation  wide-body  aircraft,  the  Boe¬ 
ing  777.  No  physical  prototype  will  be  built 
on  this  program  and  the  tools  and  jigs  will  be 
fabricated  based  on  information  from  the  vir¬ 
tual  prototype.^' 

The  long-term  goal  for  future  utilizations  of 
virtual  prototypes  is  to  permit  the  electronic 
transfer  of  prototype  information  directly  into 
manufacturing  machines  in  a  manner  where 
the  parts  can  be  created  wifii  little  or  no  hu¬ 
man  intervention. 

Based  on  our  discussions  with  personnel  at 
the  TRW  Engineering  Visualization  Center, 
animated  3-D  models  are  beconung  the  "mar¬ 
keting  essential"  in  the  initial  stages  of  win¬ 
ning  a  contract,  and  TRW  believes  it  gives 
them  the  "perceptual  edge"  in  presenting  ad¬ 
vanced  technical  concepts  and  system  de- 
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signs.  Figure  33  is  a  3-D  animation  of  a  new 
TRW  space  s)rstem  depicting  the  engineering 
staff  working  on  the  virtual  integration  of  the 
TRW  design  for  Brilliant  Eyes  satellites. 

The  TRW  program  managers  are  convinced 
that  virtual  prototypes  give  them  the  market¬ 
ing  advantage  with  potential  customers.  The 
ability  to  use  animated  graphics  to  present 
data  visually  is  especially  valuable  where  pat¬ 
terns  are  difficult  to  discern.  The  develop¬ 
ment  of  an  interactive  program  that  permits 
the  potential  customer  to  manipulate  antenna 
aim-point  and  hand-over  time  and  see  the  re¬ 
sulting  changes  in  Earth  coverage  immedi¬ 
ately,  rather  than  in  a  batch  mode,  gives  them 
a  competitive  edge.^ 

As  the  difficulty  of  conducting  business  in  the 
DOD  marketplace  continues,  earliest  estab¬ 
lishment  of  system  advocacy  will  become 
even  more  important.  Fewer  and  fewer  pro¬ 
grams  will  be  authorized  as  a  "new  start"  and 
anything  assisting  a  PM  (government  or  con¬ 
tractor)  in  gaining  a  competitive  edge  will  be¬ 
come  necessary  for  survival.  Having  a  virtual 
prototype  may  provide  the  deciding  edge  in 
obtaining  system  advocacy  in  the  future. 

Because  the  prototype  is  "virtual,"  st  can  be 
used  also  to  gain  system  advocacy  through 
electronic  participation  in  the  DOD  "elec¬ 
tronic  battlefield."  These  demonstrations  and 
evaluations  are  being  conducted  by  the  De¬ 
fense  Modeling  and  Simulation  Office 
(DMSO)  and  the  Advanced  Research  Projects 
Agency  (ARPA). 

This  capability  was  introduced  to  Senate 
Armed  Services  Committee  members  by  a 
live  demonstration  in  their  hearing  room  in 
May  1992.  Based  on  the  demonstrated  im¬ 
pacts  to  date,  the  development  of  a  virtual 
prototype  may  rapidly  become  the  single 
most  important  ingredient  in  system  advo¬ 
cacy  development 


SYSTEM  CONHCURATION 
DETERMINATION 

One  of  the  more  challenging  tasks  facing  the 
DOD  program  manager  is  persuading  the 
user  community  to  formally  describe,  ade¬ 
quately  and  accurately,  the  real  requirement 
for  the  system  as  it  makes  its  way  through  the 
acquisition  cycle.  An  even  more  difficult  task, 
however,  is  convincing  the  same  user  to  agree 
on  the  one  system  configuration  best  able  to 
meet  the  user's  needs,  that  somewhat  more 
subtle  and  amorphous  term  each  PM  feels  he 
has  an  obligation  to  strive  to  meet  because  it 
has  a  direct  impact  on  the  all-important  intan¬ 
gible  known  as  system  advocacy  —  some¬ 
times  referred  to  as  customer  and  user 
"goodwill."  Every  PM  wants  the  user  on  his 
side  throughout  the  development  process  and 
to  maintain  this  allegiance  will  accept  numer¬ 
ous  changes  and  endure  endless  philosophi¬ 
cal  discussions. 

Unfortunately,  although  the  Services  attempt 
to  identify  a  single  user  representative  for 
purposes  of  requirements  definition  and  con¬ 
tractor  system  configuration  detennination, 
the  actual  accomplishment  of  this  goal  a  sin¬ 
gle  spokesman  and  decision  maker  is  rarely 
achieved.  Army  PMs  have  formally  ap¬ 
pointed  user  representatives  called  systems 
managers  to  whom  they  can  turn  for  a  central 
point  of  contact,  but  even  this  formal  struc¬ 
ture  has  its  coordination  challenges.  In  nu¬ 
merous  programs,  the  user  is  actually  an 
amalgamation  of  individuals  and  agencies 
from  throughout  the  user  community  and 
each  has  the  desire,  as  a  minimum,  to  review 
and  recommend  changes  to  the  emerging  con¬ 
figuration  based  on  their  prior  experiences.  In 
addition,  the  PM  is  faced  with  fte  opportu¬ 
nity  to  receive  input  from  all  the  various  sp)e- 
cialties  within  the  development  conununity. 
Each  wants  to  assist  the  PM  in  determining 
the  optimum  system  configuration  and  the 
PM  must  attempt  to  accoirunodate  a  great 
deal  of  constantly  changing  input  from  this 
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multilayered  hydra  in  order  to  achieve  con¬ 
sensus  and  move  forward  with  the  design. 

What  does  a  PM  do?  In  order  to  facilitate  the 
timely  receipt  of  such  advice,  most  PMs  hold 
periodic  program  reviews  with  the  contractor 
and  representatives  from  the  user  and  devel¬ 
oper  community.  If  this  is  an  initial  meeting 
following  contract  award,  the  contractor's  de¬ 
scription  of  the  proposed  system  may  be  lim¬ 
ited  to  a  review  using  overhead  viewgraphs 
of  sketches  contained  in  the  proposal  plus  any 
subsequent  2-D  drawings  that  may  have  been 
created  since  the  award.  At  sessions  such  as 
the  Preliminary  Design  Review  and  the  Criti¬ 
cal  Design  Review,  major  efforts  will  be  made 
by  the  contractor  to  explain  his  design  and, 
where  possible,  obtain  feedback  from  the  user 
and  developer  community  on  the  accept- 
abUity  of  his  approach.  Contractors  have 
found  these  meetings  can  be  a  challenging  ex¬ 
perience  and,  because  of  difficulty  in  describ¬ 
ing  their  system  via  a  2-D  medium,  most  will 
construct  a  physical  mockup  as  a  visualiza¬ 
tion  aid  in  order  to  maximize  the  amount  of 
user  and  developer  input  received.  Depend¬ 
ing  on  the  maturity  of  the  system  being  repre¬ 
sented,  these  mockups  can  become  a 
significant  resource  and  time-consuming  in¬ 
vestment. 

With  the  aid  of  silk  screens  and  Velcro  to  fa¬ 
cilitate  subsystem  and  component  relocations, 
the  physical  mock-up  can  be  a  productive  ve¬ 
hicle  in  the  discussion  of  varying  system  con¬ 
figurations.  This  works  well  until  suggestions 
are  made  involving  changes  to  silk  screens 
that  cannot  be  made  immediately  or  cannot 
be  implemented  readily  with  available  mate¬ 
rials.  Usually,  an  agreement  will  be  made  to 
address  these  suggestions  at  a  later  date  (to¬ 
morrow,  next  week,  next  review,  etc.).  Even  if 
the  user  has  agreed  on  the  subsystem  silk- 
screen  location  in  the  mock-up,  an  engineer 
then  must  translate  this  physical  position  into 
the  appropriate  system  level  drawings.  Once 


this  update  has  been  accomplished,  each  con¬ 
tributor  wants  the  opportunity  to  review 
these  drawings  to  ensure  their  contribution 
has  been  documented  properly.  A  time  delay 
in  accomplishing  this  update  is  possible;  thus, 
approvals  cannot  be  obtained  during  the  on¬ 
site  review,  and  the  drawings  must  be  mailed 
to  all  parties  concerned.  Once  off-site,  the  re¬ 
view  process  can  become  an  opportunity  for 
the  contributor  to  not  only  review  the  draw¬ 
ing  for  accuracy  but  recommend  additional 
changes  based  on  subsequent  deliberations  or 
discussions  with  other  parties  in  the  office  or 
command.  Soon,  a  vicious  cycle  has  been  cre¬ 
ated  by  the  introduction  of  new  changes  that 
need  to  be  approved  by  multiple  parties.  Sup¬ 
pose  this  process  could  be  optimized  to  per¬ 
mit  near-real-time  evaluation  of  multiple 
recommendations  while  simultaneously 
maintaining  the  necessary  information  to  cre¬ 
ate  all  required  drawings  once  a  consensus 
had  been  reached.  Utilizing  the  visualization 
techniques  existing  today,  virtual  prototypes 
can  assist  the  contractor  and  the  government 
PM  in  accomplishing  this  task.  This  was  con¬ 
firmed  during  our  visit  to  the  Electric  Boat  Di¬ 
vision  of  General  Dynamics.  As  might  be 
expected.  Electric  Boat  has  been  expanding 
their  utilization  of  computer-based  designs  to 
reduce  design  and  manufacturing  costs  and 
remain  competitive.  They  are  using  these  ca¬ 
pabilities  in  many  innovative  ways,  one  of 
which  is  system  configuration  determination. 

After  a  general  overview  briefing  on  their  vir¬ 
tual  prototyping  capabilities,  we  received  a 
live  demonstration  of  a  virtual  prototype  in 
their  visualization  facility.  The  virtual  proto- 
tyf)e  demonstrated  had  recently  been  used 
with  a  Navy  customer  to  determine  the  sys¬ 
tem  configuration  of  an  accelerated  modifica¬ 
tion  the  user  wanted  implemented  on  a  vessel 
scheduled  to  make  a  time-sensitive  port  call. 
Because  of  a  limited  time  frame  to  gain  cus¬ 
tomer  configuration  approval.  General  Dy¬ 
namics  elected  to  use  their  new  virtual 
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prototyping  capability  to  accelerate  what 
would  normally  be  a  lengthy  iterative  process 
to  fiiulize  the  system  configuration,  ^tside 
dimensions  of  the  virtual  prototype  were 
based  on  the  physical  space  available  on  the 
vessel  to  accept  the  desired  modification.  The 
information  included  the  location  and  size  of 
existing  doors,  pipes,  electrical  lines,  etc  With 
these  dimensions  as  prototype  boundaries, 
the  Electric  Boat  team  used  their  workstations 
to  develop  digital  3-0  solid  models  of  the 
various  pieces  of  hardware  the  customer  de¬ 
sired.  These  individual  digital  hardware  mod¬ 
els  were  then  used  with  the  model  of  the  area 
to  create  an  all-encompassing  virtual  proto¬ 
type  that  represented  the  portion  of  the  ship 
where  the  installation  was  to  be  made  as  well 
as  the  irvitial  equipment  layout  for  the  in¬ 
stalled  hardware.  This  electronic  prototype 
was  then  used  with  customer  representatives 
to  determine  the  system  corrfiguration  in  the 
same  marmer  as  a  wooden  mock-up.  The 
visualization  system  allowed  the  observer  to 
open  the  door  to  the  modification  area,  chedc 
for  clearances  with  the  desk  chair  and  hard¬ 
ware  racks,  and  then  move  forward  and  sit  at 
the  desk.  The  virtual  prototype  included  a  di¬ 
mensionally  correct  representation  of  a  hu¬ 
man  operator,  and  the  model  could 
graphically  illustrate  the  operators  field  of 
view  for  checking  display  placement  and 
other  hardware  the  operator  needed  to  be 
able  to  see  from  the  chair.  During  internal  and 
external  reviews  with  their  customer,  numer¬ 
ous  hardware  locations  were  evaluated  via 
the  virtual  prototype  and  several  significant 
physical  interferences  were  identified  and 
corrected  prior  to  the  sta^  ‘  of  corwtruction.  Ex¬ 
amples  of  these  types  of  problems  were  illus¬ 
trated  and  we,  like  the  Navy  customer,  were 
able  to  enter  the  model  as  well  as  navigate 
through  its  dimensionally  correct  repre¬ 
sentation.  Once  customer  agreement  on  the 
configuration  was  reached.  Electric  Boat  cre¬ 
ated  the  top  level  layout  drawings  needed  for 
formal  concurrence  almost  immediately  since 


the  modeling  process  used  in  the  visualiza¬ 
tion  had  been  based  on  C  ATIA  drawings.  The 
General  Dynamics  briefer  stated  that,  based 
on  this  virtual  prototype  information,  the 
modification  had  been  accomplished  with  an 
usually  low  number  of  in-process  changes, 
within  the  original  sdiedule  and  to  the  satis¬ 
faction  of  the  Navy  customer.  This  capability 
has  great  potential  which  PMs  should  insist 
be  implemented  on  any  new  major  acquisi¬ 
tion. 

SYSTEM  TRADE-OFF 
STUDIES 

The  EXDD  is  faced  continuously  with  choosing 
between  competing  alternatives  to  accom¬ 
plish  a  goal.  Because  the  alternatives  being 
considered  are  normally  multifaceted  and 
complex  in  nature,  the  DOD  employs  a  pro¬ 
cess  of  system  trade-off  studies  to  help  deci¬ 
sion  makers  evaluate  the  various  options  that 
will  accomplish  the  desired  objective  at  the 
lowest  cost. 

At  a  lower  acquisition  management  level,  the 
PM  often  is  confronted  with  the  same  chal¬ 
lenge  within  his  own  system.  He  must  decide 
whether  to  incorporate  an  accurate  and  ex¬ 
pensive  guidance  subsystem  in  his  new  mo¬ 
bile  missile  system  that  allows  a  smaller 
warhead  to  be  used  to  obtain  a  specified  tar¬ 
get  kill  percentage,  or  he  can  use  a  less-accu¬ 
rate  and  less-expensive  guidance  system  with 
a  lai^er  warhead  to  achieve  the  same  level  of 
effectiveness.  In  order  to  arrive  at  the  most  ef¬ 
fective  solution  for  a  sf>ecific  need,  the  deci¬ 
sion  maker  will  most  likely  utilize  some  type 
of  systems  analysis  approach  to  help  evaluate 
the  available  alternatives.  In  the  missile  exam¬ 
ple,  the  model  may  contain  key  variables  such 
as  total  system  accuracy,  warhead  lethality 
and  target  vulnerability.  Figure  34  depicts 
these  target  destruction  submodel  factors. 

The  first  trade-off  analysis  that  would  prob¬ 
ably  be  considered  involves  the  division  of  re- 
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Figure  34.  Target  Destruction  Submodel  Factors 


Figure  35.  Target  Destruction  for  Varying 
Accuracy  and  Warhead 
Performance  Characteristics 


Figure  36.  Performance-Cost  Transfer 
Function  for  Different 
Warhead  Technologies 


sources  between  the  missile  warhead  and  the  combinations  of  warhead  accuracy  and  war- 
missile  guidance  and  control  system.  It  as-  head  lethality, 
sumes  a  fixed  target  of  a  given  hardness  and 

zero  error  in  target  position  and  launch  posi-  Figures  36  and  37  represent  performance-cost 
tion  information.  Plotted  in  Figure  35  are  functions  for  different  technological  ap- 
probability  of  kill  curves  based  on  various  proaches.  Based  on  this  data,  the  trade-off  be- 
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Figures'/.  reiformance-Cost  Transfer 
Function  for  Guidance 
Technologies 


tween  the  cost  of  warhead  lethality  and  mis¬ 
sile  accuracy  can  be  derived.  As  shown  in  Fig¬ 


ure  38,  the  plots  represent  the  most  efficient 
(lowest  cost),  technologically  feasible  way  for 
achieving  each  level  of  kill  probability.^ 

As  mentioned,  there  are  always  assumptions 
involved  in  trade-off  analysis  and  the  analyst 
attempts  to  address  the  effects  of  any  poten¬ 
tial  errors  in  such  assumptions.  Deterministic 
models  have  specific  relationships  that  will 
always  produce  the  same  answer  when  the 
same  data  is  utilized  in  the  equation,  regard¬ 
less  of  how  many  times  the  model  is  used  . 

Probabilistic  models,  on  the  other  hand,  have 
some  probability  distribution  associated  with 
the  equations  contained  in  the  model  and  can 
produce  somewhat  different  results  each  time 
the  model  is  exercised.  Both  types  of  models, 
however,  are  closed  and  thus  do  not  fully  ac¬ 
count  for  the  unpredictability  of  human  be¬ 
ings  and  their  impact  on  the  system  under 


Figure  38.  Isoeffectiveness  and  Isocost  Relationships  for  Achieving  Target  Destruction 
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evaluation.  Introducing  a  virtual  prototype, 
that  is  interactive  based  on  real-time  operator 
input  in  a  systems  trade-off  study,  would  al¬ 
low  the  analyst  to  expand  his  ability  to  collect 
realistic  total  system  level  performance  data 
for  use  in  the  trade-off  analysis.  More  impor¬ 
tant,  it  would  enable  the  engineers  to  visual¬ 
ize,  maybe  for  the  first  time,  the  interactive 
results  of  what  previously  has  been  2-D  tables 
of  data  and  thousands  of  complicated  ecpia- 
tions.  Adding  the  human  element  to  any  pre¬ 
viously  closed  model  scenario  has  the 
potential  to  produce  unexpected  results.  As 
evidenced  by  the  following  statement  made 
during  Desert  Storm  by  General  H.  Norman 
Schwarzkopf:^^ 

Analysts  mite  about  war  as  if  it  is  a  ballet, 
like  it's  choreographed  ahead  of  time  and 
when  the  orchestra  strikes  up  and  starts 
playing,  everyone  goes  out  there  and  plays  a 
set  piece.  What  I  always  say  to  those  folks  is, 
'Yes,  it's  choreographed,  and  what  happens  is 
the  orchestra  starts  playing  and  some  SOB 
climbs  out  of  the  orchestra  pit  with  a  bayonet 
and  starts  chasing  you  around  the  stage  and 
the  choreography  goes  right  out  the  window.' 

The  ultimate  trade-off  study  environment  en¬ 
visioned  by  EXDD  is  still  a  few  years  off.  It  will 
be  based  on  a  totally  interactive  "electronic 
battlefield"  that  contains  accurate  terrain  data 
and  variable  weather  parameters.  It  will  be 
populated  via  distributed  simulation  with  re¬ 
alistic  virtual  weapon  systems  that  respond  to 
real-time  inputs  from  real  operators,  and  the 
semiautomated  forces  will  be  under  the  com¬ 
mand  of  real  commanders.  With  this  elec¬ 
tronic  capability  as  the  "test  track"  for 
evaluation  of  new  technology,  trade-off  stud¬ 
ies  will  take  on  a  whole  new  meaning.  No 
longer  will  the  analytical  process  described 
above  be  enough  for  a  decision.  Each  system 
will  have  to  prove  itself  on  this  new  sand  ta¬ 
ble  of  the  future.  The  ultimate  test  will  be  to 
demonstrate  value-added  war  fighting  capa¬ 


bility  that  is  significant  enough  to  influence 
the  outcome  of  the  conflict  that  takes  place  in 
the  specified  battlespace.  Proposed  new  tanks 
will  be  evaluated  not  only  against  existing 
tanks  but  against  other  potential  weapon  sys¬ 
tem  solutions  such  as  attack  helicopters,  at¬ 
tack  aircraft,  robotic  high  energy-weapons, 
etc.  For  the  first  time  the  decision  maker  will 
be  able  to  assess  via  real-time  visualization 
the  warfighting  impact  of  a  proposed  weapon 
system  before  expending  several  hundred 
million  or  billion  dollars  to  develop  the  first 
physical  prototype. 

Although  the  ultimate  trade-off  analysis  tool 
has  not  been  completely  developed,  subsets 
of  this  capability  exist  today.  They  can  be 
found  at  DOD  simulator  training  facilities  at 
Fort  Rucker,  Fort  Knox,  and  Williams  AFB;  at 
the  Army's  Aeroflightdynamics  Directorate  at 
NASA/ Ames;  and  at  major  DOD  contractor 
facilities,  such  as  Boeing,  General  Dynamics, 
and  Sikorsky.  Most  of  these  interactive  simu¬ 
lators  are  already  electronically  linked  via  the 
DOD  Distributed  Interactive  Simulation  net¬ 
work  and  additional  contractors  with  their 
virtual  prototypes  are  expected  to  join  this 
"electronic  battlefield"  in  the  near  future. 
During  our  visit  to  the  Sikorsky  facility,  we 
were  allowed  to  "fly"  with  the  Sikorsky  test 
pilot  in  the  "Boeing  Sikorsky  RAH-66  Co¬ 
manche  Team's"  virtual  prototype  of  the 
Army's  latest  helicopter.  One  of  the  many  cur¬ 
rent  uses  being  made  of  this  virtual  prototype 
is  the  generation  of  data  in  support  of  trade 
studies.'® 

Major  efforts  are  underway  to  improve  the 
commimications  infrastructure  in  order  to  fa¬ 
cilitate  the  completion  of  this  futuristic  elec¬ 
tronic  battlefield.  The  Clinton  administration 
is  committed  to  the  rapid  advancement  and 
expansion  of  virtual  prototyping  technology 
and  the  budgets  for  the  Advanced  Research 
Projects  Agency  and  the  Defense  Department 
efforts  in  this  area  now  exceed  one  billion  dol- 
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lars.  The  ARPA  War  Breaker  project,  for  exam¬ 
ple,  has  recently  been  increased  to  more  than 
$750  million.^*  Because  it  can  provide  the  de¬ 
cision  maker  with  an  expanded  evaluation  ca¬ 
pability,  virtual  prototypes  will  become 
essential  to  the  system  trade-off  studies  of  the 
future.  Color  Plate  4,  taken  during  Phase  One 
(The  Zealous  Pursuit  Exercise)  of  the  ARPA 
War  Breaker  program,  vividly  illustrate  the 
emerging  "electronic  battlefield"  of  the  future. 

COST  ANALYSIS 

According  to  guidance  contained  in  DODI 
5000.2,  cost  and  operational  effectiveness 
analyses  (COEA)  are  prepared  and  consid¬ 
ered  at  every  acquisition  Category  I  program 
milestone  decision  review  starting  witii  Mile¬ 
stone  I,  Concept  Demonstration  Approval. 
The  COEA  should  aid  decision  makers  in 
judging  whether  or  not  any  of  the  proposed 
alternatives  to  the  program  offer  sufficient 
military  benefit  to  be  worth  the  cost.  There  are 
several  subanalyses  that  usually  are  utilized 
to  develop  the  COEA.  Analyses  of  rtussion 
needs,  threat,  measures  of  effectiveness,  and 
costs  are  typically  included  in  every  COEA. 
Measures  of  effectiveness  are  used  to  gauge 
the  military  utility  of  specified  outputs.  The 
cost  analysis,  on  the  other  hand,  assesses  the 
resource  implications  of  associated  inputs. 
Each  cost  estimate  must  be  explicitly  based  on 
the  program  objectives,  operational  require¬ 
ments  and  contract  specifications  for  the  sys¬ 
tem,  including  plans  for  such  things  as 
{peacetime  utilization  rates  and  how  the  sys¬ 
tem  will  be  maintained.  Life  cycle  costs  must 
be  identified  for  each  alternative  being  con¬ 
sidered  in  the  COEA  and  separate  estimates 
of  operations  and  maintenance  costs  must  be 
made,  particularly  for  manpower  and  person¬ 
nel  and  training  costs.^^ 

Two  separate  cost  estimates  are  prepared  for 
Milestone  I  and  all  subsequent  milestone  re¬ 
views.  One  is  prepared  by  the  program  office 
and  the  other  by  an  oiganization  not  report¬ 


ing  through  the  acquisition  chain.  The  Office 
of  the  Secretary  of  Defense  Cost  Analysis  Im¬ 
provement  Group  (CAIG)  provides  a  report 
on  the  cost  of  acquisition  Category  ID  pro¬ 
grams  to  the  USD(A&T)  and  for  category  IC 
to  the  DOD  Component  Acquisition  Execu¬ 
tive.  The  DOD  Component  responsible  for  the 
acquisition  of  a  system  must  support  the 
CAIG  in  the  preparation  of  their  report  by 
providing  cost  progiammatic  and  technical 
information  required  to  estimate  the  costs  and 
appraise  the  cost  risks  associated  with  the 
system.^®  Usually,  this  information  is  pro¬ 
vided  in  a  work  breakdown  structure  orienta¬ 
tion  and  each  cell  of  the  cost  estimate  will 
usually  have  some  type  of  cost  rationale  ex¬ 
plaining  the  basis  of  estimate.  Depending  on 
the  acquisition  phase  of  the  system,  the  cost 
analysis  may  be  detailed  and  represent  the 
work  of  a  cost-estimating  department  that  has 
spent  a  tremendous  number  of  hours  with  de¬ 
sign  and  manufacturing  engineers  trying  to 
gain  an  appreciation  for  the  magnitude  of 
what  and  how  it  will  be  built  Estimating 
costs  based  on  engineering  sketches  or  even 
released  drawings  is  a  difficult  task  and  in¬ 
herent  in  the  estimate  that  is  produced  is  the 
estimator's  assessment  of  risk  to  finalize  the 
design  and  actually  build  the  part,  board  or 
subassembly.  The  cost  estimate  associated 
with  the  final  assembly  and  test  of  this  new 
system  is  also  significantly  influenced  by  the 
cost  estimator's  assessment  of  the  risk  in¬ 
volved. 

Translating  the  dimensional  information  on 
hundreds  of  drawings  into  a  mental  image  of 
what  the  system  will  look  like,  how  it  will  be 
built,  how  it  will  be  tested,  and  then  convert¬ 
ing  this  information  into  a  cost  estimate  is  a 
significant  challenge.  This  task,  especially  the 
risk  evaluation,  would  be  much  easier  and 
more  accurate  if  the  individuals  involved  in 
the  cost-estimating  process  could  somehow 
see  and  touch  the  product  they  are  being 
asked  to  design  and  build.  Instead  of  trying  to 
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mentally  visualize  and  cost  a  complex  subma¬ 
rine  command  center  that  may  take  more 
than  1,000  engineering  drawings  2-D  format 
to  describe,  wouldn't  it  be  helpful  for  a  cost 
estimator  to  enter  the  submarine  command 
center  with  the  design  and  manufacturing  en¬ 
gineers  and  together  "see"  the  product  that 
must  be  costed?  The  risk  assessment  by  the 
cost  estimator  would  certainly  be  more  accu¬ 
rate  if  die  engineer  exercised  the  moveable 
parts,  opened  the  door,  raised  or  lowered  the 
periscope  and  checked  for  interferences, 
could  see  and  reach  the  display  controls  from 
the  operator  seat  without  having  to  stand  up; 
demonstrated  there  are  no  two  structures  on 
the  vessel  trying  to  occupy  the  same  space  at 
the  same  time;  and  confirmed  that  the  same 
database  used  to  create  this  virtual  prototype 
would  drive  the  numerically  controlled  ma¬ 
chines  on  the  manufacturing  floor  to  build 
identical  hardware. 

In  addition  to  assisting  the  contractor  and 
program  office  cost  estimators,  virtual  proto¬ 
types  can  be  used  to  provide  valuable  cost-es¬ 
timating  information  to  the  CAIG.  Most 
important  of  all  due  to  their  digital  nature, 
they  could  actually  be  brought  to  the  mile¬ 
stone  decision  briefing  and  allow  the  decision 
makers  to  gain  a  hrsthand  impression  of  the 
system  being  evaluated. 

RESEARCH  AND  DEVELOPMENT 
Requirements  Definition 
As  discussed  earlier,  IX5DD  5000.1  specifies 
the  management  framework  within  which 
military  requirements  are  expressed  initially 
in  broad  operational  terms.  Throughout  this 
process  there  is  ample  opportunity  to  utilize 
virtual  prototyping  and  simulation  to  en¬ 
hance  the  effectiveness  of  requirements  re¬ 
finement. 

Recognition  exists  today  at  the  highest  levels 
within  DOD  that  Advanced  Distributed 
Simulation  and,  thus,  virtual  prototyping  can 


"markedly  improve  the  requirements  defini¬ 
tion  and  refinement;  research,  development, 
and  acquisition"  process.^’  Distributed  inter¬ 
active  simulation  and  virtual  prototyping  can 
create  a  synthetic  environment  where  opera¬ 
tional  and  technical  innovation  can  flourish. 
One  can  examine  what  current  systems  are 
doing  and  ask  how  those  systems  can  be  bet¬ 
ter  employed,  used  in  new  and  different 
ways,  improved  upon  or  replaced  with  other 
capabilities.  General  William  E.  DePuy,  USA 
(Ret.),  believed  research  and  development  is  a 
circular  process: 

The  relationship  between  the  research  com¬ 
munity,  the  developers  and  the  users,  is 
clearly  circular.  That  is,  the  relationship  is 
interactive  and  continuously  so.. ..Research 
is  not  conducted  without  an  awareness  of  po¬ 
tential  applications.  Development  of  tlwse 
applications  is  not  undertaken  in  an  employ¬ 
ment  vacuum.  Concepts  of  employment  are  a 
synthesis  of  tactical  experietwe  and  new 
technical  capabilities.^^ 

While  the  defense  acquisition  process  as  de¬ 
scribed  in  DODD  5000.1  appears  to  be  a  linear 
activity  from  the  sequence  of  the  milestone 
decision  points,  the  activities  prior  to  Mile¬ 
stone  0  and  within  each  phase  are  circular  in 
nature  —  especially  in  the  early  portion  dur¬ 
ing  requirements  definition  and  concept  stud¬ 
ies.  The  goal  of  this  circular  process  is  to 
establish  the  military  worth  of  new  concepts 
and  new  hardware. 

A  powerful  example  of  how  virtual  prototyp¬ 
ing  can  be  beneficial  was  conducted  by  Gen¬ 
eral  Paul  E  Gorman,  USA  (Ret),  who  led  the 
presentation  of  DIS  technology  to  the  Senate 
Armed  Services  Committee  on  21  May  1992. 
Included  in  the  presentation  was  a  virtual 
prototype  of  a  Line  of  Sight  Anti-Tai\k 
(LOSAT)  weapon  whose  components  have 
been  partially  developed  and  tested  but  for 
which  there  is  no  weapon  system  in  DOD. 


66  -  Synthetic  Environments  in  Acquisition 


Virtual  Prototyping:  Concept  to  Production 


This  virtual  LOSAT  was  operated  on  an  elec¬ 
tronic  battlefield  consisting  of  an  F-16  fighter 
aircraft,  an  AH-64  attack  helicopter  and  an 
OH-58D  observation  helicopter  and  an  M-1 
tank  —  all  manned  simulators.  The  signifi¬ 
cance  of  this  demonstration  was; 

—  Virtual  prototypes  can  be  produced  quickly 
and  at  a  relatively  low  cost  compared  to 
physical  prototypes. 

—  A  great  amount  of  realism  can  be  incorpo¬ 
rated  in  the  simulation. 

—  Proposed  weapon  systems  can  be  endowed 
with  characteristics  for  which  technological 
solutions  are  not  immediately  at  hand  and 
without  the  expense  of  achieving  the  tech¬ 
nical  solution. 

—  Virtual  prototypes  can  be  operated  by  the 
user  in  advance  of  committing  funding  and 
laige  development  programs  to  produce  an 
article  for  test  and  evaluation. 

A  second  successful  example  of  virtual  proto¬ 
typing  can  be  seen  in  the  experience  of  the  M- 
1  tank  upgrade  program.  In  1984,  the  Army 
initiated  a  physical  prototype  of  an  M-1  tank 
with  upgraded  fire  control  and  loader  func¬ 
tions.  After  24  months  and  at  a  cost  of  $40 
million,  the  prototype  was  not  functional.  Ef¬ 
fort  was  shifted  from  a  physical  prototype  to 
a  virtual  prototype  using  a  modified  aircraft 
dome  in  1986.  V^thin  six  months  and  at  a  cost 
of  $1  million,  the  test  objectives  were 
achieved.  Virtual  prototyping  has  substantial 
potential  to  improve  and  shorten  the  time 
from  requirements  definition  to  physical  pro¬ 
totyping. 

Virtual  prototyping  allows  investigating  the 
feasibility  and  conducting  risk  assessments 
on  potential  weapon  systems.  Virtual  proto¬ 
types  can  increase  the  confidence  of  a  design 
prior  to  constructing  the  physical  prototype. 


thus  decreasing  cycle  time  and  reducing 
costly  errors.  As  confidence  increases,  one  can 
consider  skipping  steps  in  the  acquisition 
process  since  the  basis  of  skipping  steps  is 
confidence. 

Engineering  Design  Support 
As  a  system  proceeds  from  the  concept  stage 
into  engineering  development,  modeling, 
simulation  and  virtual  prototypes  play  an  im¬ 
portant  role.  Numerous  engineering  design 
issues,  including  mechanical  stress,  heat 
transfer,  radar  response  and  flight  dynamics, 
to  name  a  few,  are  best  solved  using  virtual 
prototypes.  Using  virtual  prototypes  is  not  a 
substitute  for  physical  testing,  but  it  can 
speed  up  the  testing  process  by  ensuring  the 
first  physical  items  built  are  highly  accurate. 
Many  cycles  of  design  alternatives  can  be 
"tested"  quickly  before  committing  to  build¬ 
ing  a  physical  prototype.  This  technique 
avoids  false  starts  which  waste  time. 

Virtual  prototypes  allow  design  engineers  to 
visualize  the  end  product  of  the  design  pro¬ 
cess.  \fisualization  is  an  effective  stimulus  for 
the  creative  thought  process  due  to  the  large 
amount  of  information  which  is  absorbed  at 
one  time.  The  ability  to  visualize  a  product 
also  contributes  favorably  to  the  concurrent 
engineering  process.  Ihree-dimensional  mod¬ 
els  can  be  viewed  and  understood  by  design¬ 
ers  from  all  disciplines  more  easily  than  2-D 
drawings  that  are  often  rendered  for  a  specific 
discipline. 

TESTING  AND  EVALUATION 
Early  Operational  Assessment 
According  to  guidance  provided  in  IX)D1 
5000.2,  multiple  design  approaches  and  paral¬ 
lel  technologies  must  be  pursued,  when  war¬ 
ranted,  in  Phase  1,  Demonstration  and 
Validation,  of  an  acquisition.  Requirements 
for  this  phase  indude  an  evaluation  of  sup- 
portability  and  manufacturing  process  de¬ 
sign.  Prototyping  testing  and  early 
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operational  assessment  of  critical  systems, 
subsystems  and  components  are  to  be  empha¬ 
sized.  Cost  drivers  and  alternatives  must  be 
identified  and  analyzed,  and  each  design  ap¬ 
proach  must  be  further  analyzed  as  a  function 
of  risk  and  the  expected  increase  in  opera¬ 
tional  capability.^' 

It  is  extremely  important  these  evaluations 
are  as  accurate  as  possible  because  historical 
data,  shown  in  Figure  29,  indicates  that  more 
than  80  percent  of  a  total  system  cost  is  deter¬ 
mined  by  decisions  made  prior  to  the  end  of 
the  Demonstration  and  Validation  Phase. 

The  purpose  of  prototyping,  testing  and  early 
operational  assessment  is  to  identify  and  re¬ 
duce  risk,  and  assess  the  most  promising  de¬ 
sign  approach  to  determine  how  the  system 
will  operate  in  the  intended  operational  envi- 
romnent.  This  assessment  must  address  the 


performance  impacts  on  the  system  associ¬ 
ated  with  the  human  operator,  as  well  as  the 
ability  of  the  design  to  operate  under  different 
environmental  conditions.^^ 

Because  the  cost  of  full-scale  prototyping  for 
today's  major  weapons  systems  is  so  large, 
many  contractors  are  developing  a  lower  cost 
alternative  to  accomplish  these  critical  Phase  I 
evaluations.  High-fidelity  simulation  now 
permits  designers  to  create  a  virtual  proto¬ 
type  that  can  be  used  for  tire  majority  of  these 
evaluations,  including  operator  and  environ¬ 
mental  assessments.  Figure  40,  provided  dur¬ 
ing  our  visit  to  the  Boeing  Sikorsky  RAH-66 
Comanche  Team,  highlights  the  many  uses  of 
their  virtual  prototype,  referred  to  as  the  Co¬ 
manche  Piloted  Simulation. 

Virtual  prototypes  are  being  utilized  for  early 
operational  assessments  by  commercial  as 
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COMANCHE  PILOTED  SIMULATION 

SIMULATION 

We  use  it  for: 

•  Iterating  on  the  design  of  the  crewstation  cockpit 

•  Evaluating  prototype  designs  in  a  realistic  environment 

•  Developing  flight  control  laws  and  assessing  aircraft 
handlinn  qualities  with  respect  to  specification 
requirements 

•  Generating  data  in  support  of  trade  studies 

•  Prototyping  design  concepts  and  filtering  them  before 
they  are  committed  to  an  aircraft  design,  prototype  or 
production 

•  Defining  detail  elements  of  the  pilot  vehicle 
interface  specifications 

•  Defining/Identifying  crew  workload  and  confirming 
predictions  from  other  methodologies. 


Figure  40.  Virtual  Prototype  Utilization  on  Comanche 


well  as  military  contractors.  Boeing  Aircraft  is 
using  their  virtual  prototype  of  the  Boeing  777 
to  accomplish  numerous  operational  assess¬ 
ments  prior  to  actual  production  and  assem¬ 
bly.  Boeing  has  such  a  high  level  or  confidence 
in  the  fidelity  of  their  virtual  prototype  that 
they  are  not  going  to  build  a  physical  mockup 
or  flyable  prototype.^  Additional  examples  of 
companies  using  virtual  prototypes  for  eariy 
operational  assessment  can  be  found  in  Chap¬ 
ter  5. 

DEVELOPMENTAL  AND 
OPERATIONAL  TEST  DESIGN 
Policies  and  procedures  establishing  the  basis 
for  conducting  test  emd  evaluation  activities 
in  support  of  the  DOD  acquisition  process  are 
set  forth  in  Part  8  of  DODI  5000.2.  The  policy 
states  that  test  and  evaluation  programs  are 
structured  to: 


—  Provide  essential  infoimation  for  assess¬ 
ment  of  acquisition  risk  and  for  decision 
making 

—  Verify  attainment  of  technical  performance 
specifications  and  objectives 

— Verify  that  systems  are  operationally  effec¬ 
tive  and  suitable  for  intended  use 

—  Provide  essential  information  in  support  of 
decision  making. 

Test  objectives  for  each  phase  shall  be  de¬ 
signed  to  demonstrate  system  performance 
appropriate  to  each  phase  and  milestone.  Test 
planning  begins  in  Phase  0,  Concept  Explora¬ 
tion  and  Definition,  and  continues  through¬ 
out  each  subsequent  phase.  Developmental 
and  operational  testers  are  involved  to  ensure 
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the  test  program  for  the  most  promismg  alter¬ 
native  can  support  the  acquisition  strategy. 
Test  planning,  at  a  minimum,  must  address 
all  system  components  critical  to  the  achieve¬ 
ment  and  demonstration  of  contract  technical 
performance  specifications  and  minimum 
acceptable  operational  performance  require¬ 
ments  specified  in  the  Operational  Recjuire- 
ments  Document.  The  Test  and  Evaluation 
Master  Plan  (TEMP)  should  focus  on  the 
overall  structure,  major  elements,  and  objec¬ 
tives  of  the  test  program  that  is  consistent 
with  the  acquisition  strategy.  Live  fire  testing 
and  evaluation  must  be  conducted  on  Cate¬ 
gory  I  and  II  programs  for  a  vehicle,  weapons 
platform  or  conventional  weapxm  system  de¬ 
signed  to  provide  some  degree  of  protection 
to  the  user  in  combat  It  also  must  be  con¬ 
ducted  for  a  major  munition  or  missile.  Test¬ 
ing  shall  be  planned  and  conducted  to  take 
advantage  of  the  existing  investment  in  DOD 
ranges,  facilities  and  other  resources,  wher 
ever  possible.^ 

The  specific  content  and  format  of  the  TEMP 
are  detailed  in  Part  7  of  DOD  5000.2-M,  "De¬ 
fense  Acquisition  Management  Documenta¬ 
tion  and  Reports,"  February  1991.  The  TEMP 
documents  the  overall  structure  and  objec¬ 
tives  of  the  test  and  evaluation  pnagram.  It 
provides  a  framework  wittiin  which  to  gener¬ 
ate  detailed  test  and  evaluation  plans  and  it 
documents  schedule  and  resource  implica¬ 
tions  associated  with  the  test  and  evaluation 
program. 

Now  comes  the  hard  part!  What  specific  test 
should  be  required,  and  how  should  the  test 
be  structured  to  verify  adequate  performance 
against  a  given  criteria?  How  many  different 
scenarios  and  data  collection  runs  are  re¬ 
quired  to  adequately  demonstrate  an  accept¬ 
able  product?  What  is  the  impact  of  the 
human  operator  on  the  performance  of  the 
system?  Are  all  the  system's  critical  opera¬ 
tional  displays  within  the  operator's  primarj' 


field  of  view?  What  is  the  impact  of  full  sun¬ 
light  through  the  canopy  on  the  pilot's  ability 
to  read  the  mission  critical  instruments  or  the 
effect  of  night  vision  goggles  on  the  pilot  or 
crew  member?  If  the  budget  only  allows  some 
finite  level  of  testing,  how  is  maximum  return 
for  each  test  dollar  realized?  Determining 
what  and  haw  to  test  thus  is  not  an  insignifi¬ 
cant  task;  it  is  potentially  as  difficult  as  con¬ 
ducting  the  test. 

Today's  computer  technology,  if  properly  ap¬ 
plied,  is  capable  of  providing  the  develop¬ 
mental  and  operational  tester  with  a  way  to 
conduct  meaningful  evaluations  to  aid  in  de¬ 
signing  the  tests  to  be  performed  during  each 
acquisition  phase.  A  virtual  prototype,  devel¬ 
oped  as  a  scientific  visualization  in  the  Con¬ 
cept  Exploration  and  Development  phase  and 
continuously  enhanced  throughout  the  devel¬ 
opment  process,  can  provide  the  test  commu¬ 
nity  with  the  ability  to  optimize  the  number 
of  tests  to  be  conducted  as  well  as  reduce  the 
time  required  to  collect  the  required  data.  Be¬ 
cause  the  virtual  prototype  exists  in  a  digital 
world,  the  tester  has  the  opportunity  to  con¬ 
duct  numerous  iterations  of  the  same  test  sce¬ 
nario  and  thus  isolate  the  critical  test  issues 
that  have  the  highest  impact  on  the  validation 
and  verification  of  the  system's  critical  devel¬ 
opmental  and  operational  parameters. 

The  visualization  and  fidelity  of  some  virtual 
prototypes  have  now  reached  the  stage  where 
the  engineers  and  testers  are  able  to  obtain 
more  useful  data  from  the  virtual  prototype 
than  from  an  operational  physical  mockup. 
By  using  a  virtual  prototype,  the  tester  can 
electronically  change  the  environment,  threat 
and  platform  sp)eed  and  measure  the  resultant 
impact  on  system  performance.  This  informa¬ 
tion  can  then  be  used  to  optimize  the  required 
test  designs.  It  would  be  almost  impossible  to 
achieve  or  afford  this  level  of  test  flexibility  in 
the  real  world.  Figure  41  contains  the  Boeing 
Sikorsky  estimate  of  the  developmental  test 
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Fj^re  41.  Comanche  Virtual  Prototype  Developmental  Cost  Savings 


hours  that  can  be  saved  in  the  Comanche 
flight  controls  area  through  use  of  their  simu¬ 
lation  capability. 

Sikorsky  engineers  believe  the  more  the  com¬ 
plexity  and  capability  of  the  developmental 
system  is  increased  prior  to  production,  the 
more  significant  is  the  expected  cost  benefit 
from  the  use  of  simulation.  This  relationship 
is  extremely  important  and  should  be  one  the 
government  stresses  in  its  consideration  and 
negotiation  of  resource  allocations  for  future 
capability  enhancements.  Total  system  sav¬ 
ings  resulting  from  the  use  of  the  Comanche 
simulation  (virtual  prototype)  are  estimated 
to  be  more  than  $6()0  nuUion.  See  Chapter  5 
for  a  more  detailed  discussion  of  simulation 
on  the  Comanche  program. 


Is  there  a  way  to  accomplish  all  or  a  portion 
of  the  developmental  and  operational  test 
without  having  to  actually  fly  the  aircraft, 
drive  the  tank,  or  fire  the  missile?  Building 
operational  prototypes  to  accomplish  each  of 
these  tests  can  be  extremely  expensive  and 
time-consuming.  This  situation  may  be  fur¬ 
ther  exacerbated  if  the  type  of  test  called  for 
requires  multiple  evaluations  imder  different 
environmental  conditions.  If  each  missile  pro¬ 
totype  costs  several  million  dollars  to  build, 
or  a  billion  dollars  in  the  case  of  the  RAH-66 
helicopter  or  the  F-22  aircraft,  nunimizing  the 
number  of  physical  prototypes  required  to  ac¬ 
complish  the  internally  or  externally  required 
developmental  and  operational  evaluations 
would  be  extremely  cost  beneficial.  Substitut¬ 
ing  a  virtual  prototype  for  a  physical  proto- 
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type  in  all  or  some  portion  of  the  tests  involv¬ 
ing  destructive  testing  and  fatigue  analysis 
would  allow  the  tester  to  "dry  run"  the  test 
scenario  to  optimize  it  for  the  real  prototype, 
determine  practical  test  limitations,  and  in 
many  cases  actually  conduct  additional  tests 
that  may  not  be  affordable  if  the  virtual  proto¬ 
type  did  not  exist. 

A  more  productive  and  affordable  test  alter¬ 
native  might  be  to  use  a  virtual  prototype  to 
evaluate  the  system  without  having  to  build 
any  physiccil  prototypes.  Based  on  our  re¬ 
search  visits  to  commercial  as  well  as  military 
contractors,  we  believe  the  current  virtu^ 
prototyping  capabilities  have  eliminated  the 
test  community's  need  for  most  physical  pro¬ 
totypes,  especially  in  the  IX)D  acquisition 
phases  prior  to  Engineering  and  Manufactur¬ 
ing  Development  In  commercial  product  de¬ 
velopment  such  as  automobiles  and  aircraft, 
virtual  prototyping  has  the  potential  to  elimi¬ 
nate  at  least  one  iteration  of  the  development 
cycle  while  still  providing  the  necessary  test 
data  to  support  developmental  and  opera¬ 
tional  assessments  such  as  operator  visibility, 
ease  of  use,  vibration,  crash  tests  and  cus¬ 
tomer  feedback.  The  Boeing  discussion  in 
Chapter  5  provides  an  additional  example  of 
how  virtual  prototypes  are  being  utilized  by 
irmovative  contractors  witii  state-of-ttie-art 
capabilities. 

EXCURSION  AND 
SENSITIVITY  ANALYSES 
Evaluating  different  approaches  to  a  particu¬ 
lar  objective  has  always  been  one  of  the  main 
functions  of  the  analytical  community.  Can 
the  problem  be  solved  by  a  commercial  air¬ 
craft  carrying  an  observer  with  a  Browrue 
camera;  will  a  commercial  aircraft  with  a  high 
resolution  CCD  camera  and  a  powerful  woA- 
station  be  required;  or  are  special  nulitary  air¬ 
craft  and  expensive  sensors  necessary? 
Include  in  this  analyses  an  evaluation  of  a 
standoff  platform  with  long-range  sensors  as 


well  as  a  low-flying  aircraft  witti  shorter- 
range  sensors  requiring  overflight  auttioriza- 
tion.  Also  consider  an  alternative  that  uses  a 
high-flying  platform  requiring  overflight.  An 
evaluation  of  all  these  different  excursions 
may  be  directed  before  a  program  approval  is 
given.  Even  within  an  approved  program  the 
desire  or  requirement  to  evaluate  different  al¬ 
ternatives  is  constant.  The  user,  OSD  and 
Congress  want  to  know  what  would  happen 
if  a  different  radar  was  installed  in  the  air¬ 
craft,  the  existing  individual  displays  were  re¬ 
placed  by  a  multifunction  display,  or  one  of 
four  workstations  on  the  platform  is  elimi¬ 
nated?  Currently,  evaluations  for  the  types  of 
excursions  mentioned  would  be  based  on  a 
paper  study  that  takes  data  from  available 
tedmical  data  sheets;  combines  it  with  the  ex¬ 
pected  environmental  conditions,  desired 
photo  characteristics  resolution  and  stabiliza¬ 
tion  requirements  associated  with  short-  or 
long-range  optics;  and  then  attempts  to  piece 
together  a  composite  set  of  information  repre¬ 
senting  the  performance  that  could  poten¬ 
tially  be  obtained  from  each  aircraft  excursion 
evaluated.  Unless  one  of  the  excursions  was 
based  on  an  existing  system,  the  paper  analy¬ 
sis  will  not  provide  an  accurate  total  system 
performance  because  the  analysis  has  no  way 
to  evaluate  all  the  potential  interactions  of  the 
various  components,  environment  and  the 
human  operator.  How  stable  the  aircraft  actu¬ 
ally  flies  in  a  given  enviroiunent  and  whether 
the  vibration  imparted  to  the  camera  mount 
causes  unacceptable  distortions  all  go  to¬ 
gether  to  create  uncertainty  in  how  well  the 
individual  pieces  might  function  together  as  a 
hardware  system.  Couple  this  with  the  hard- 
to-characterize  performance  impact  of  a  hu¬ 
man  operator  on  a  given  set  of  equipment, 
and  the  total  system  performance  evaluation 
can  be  little  more  than  an  educated  guess. 

In  sensitivity  analysis,  the  analyst  will  vary 
one  input  in  the  equation,  model,  forecast, 
etc.,  and  then  analyze  the  impact*  Compar- 
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ing  the  delta  change  in  the  end  result  to  the 
delta  change  in  the  input  used  to  cause  the 
change  for  every  variable  in  the  model  will 
yield  sensitivity  data  the  analyst  can  use  to 
identify  areas  where  the  most  benefit  c£m  be 
gained  for  the  smallest  incremental  increase. 
Sensitivity  analyses  in  DOD  applications  are 
designed  to  show  how  military  utility  is  af¬ 
fected  by  changes  in  system  capability.  For  ex¬ 
ample,  increasing  a  system  characteristic  such 
as  size  or  weight  by  a  certain  amount  may  im¬ 
pact  the  system's  performance  which,  in  turn, 
may  affect  military  utility  or  effectiveness. 
The  analysis  will  show  where  we  are  on  the 
curve  tmd  whether  the  desired  performance  is 
stretching  the  system  to  where  increases  in 
performance  add  little  benefit. 

Seirsitivity  analysis  illuminates  the  impor¬ 
tance  of  incorporating  certain  features  in  a 
system.  Is  adding  wing  surface,  changing 
wing  shape,  or  altering  some  other  design  pa¬ 
rameter  die  best  way  to  increase  aircraft  lift? 
In  theory,  sensitivity  analysis  should  be  rela¬ 
tively  straightforward  since  only  one  input  is 
varied  in  the  equatior\s  being  used  to  define 
the  condition.  Each  part  of  the  equation  can 
be  subsequently  evaluated  in  the  same  man¬ 
ner  to  determine  which  factor  has  the  greatest 
impact  on  the  result.  This  scenario,  however, 
becomes  much  more  complicated  when  real- 
world  measurements  are  required  to  confirm 
the  equation  accuracy  or  when  the  situation 
or  condition  to  be  analyzed  cannot  be  com¬ 
pletely  and  accurately  represented  by  mathe¬ 
matical  equations.  Unless  multiple  versions  of 
the  excursion  can  be  operated  simultaneously, 
repeatability  of  the  evaluation  for  sensitivity 
of  a  specific  variable  may  be  difficult  to  ob¬ 
tain.  The  humidity,  amount  of  sunlight  or 
temperature  may  have  changed  before  an¬ 
other  evaluation  can  be  conducted. 

Sensitivity  analysis  associated  with  an  under¬ 
developed  system  can  be  even  more  challeng¬ 
ing.  Trying  to  characterize  the  system  in  a  set 


of  equations  that  will  reflect  system  perform¬ 
ance  accurately  may  be  beyond  the  capability 
of  today's  analytical  systems.  If  a  virtual  pro¬ 
totype  existed  as  the  basis  for  each  excursion, 
evaluation  could  be  accomplished  meaning¬ 
fully  and  convincingly.  Each  excursion  could 
be  exercised  against  a  specific  target  set  on  the 
electronic  battlefield  and  the  resultant  data 
could  be  analyzed  to  determine  which  hard¬ 
ware  configuration  produced  the  most  benefi¬ 
cial  performance.  Because  the  environment 
used  for  the  evaluation  of  excursions  is  repre¬ 
sented  in  a  digital  format,  it  lends  itself  to  un¬ 
biased  and  accurate  assessments  of  each 
excursion.  The  electronic  battlefield  is  even 
more  useful  to  sensitivity  analysis  because  the 
same  scenario  can  be  run  repeatedly  with  the 
assurance  that  variables  such  as  weather,  time 
of  day,  platform  speed,  or  turbulence  will  be 
the  same  unless  intentionally  changed  by  the 
analyst  Virtual  prototypes  operating  in  an 
electronic  battlefield  will  become  a  powerful 
sensitivity  analysis  tool  the  analyst  can  use  to 
optimize  system  performance,  and  this  opti¬ 
mization  can  be  accomplished  before  any 
hardware  manufacture  begins.  During  our 
visit  to  Boeing,  for  example,  they  demon¬ 
strated  how  they  successfully  used  their  vir¬ 
tual  prototype  of  the  F-22  in  sensitivity 
analyses  in  the  design  process  to  reduce  the 
radar  signature. 

PRODUCTION  AND  LOGISTICS 
During  1992,  the  Defense  Science  Board  (DSB) 
evaluated  manufacturing  processes  and  laid 
out  the  vision  of  M&S  application  in  the  engi¬ 
neering  and  manufacturing  process.  The  term 
Integrated  Product  Process  Development 
(IPPD)  is  used  to  describe  all  activities  occur¬ 
ring  from  concept  development  to  field  sup¬ 
port.  The  primary  objective  of  the  IPPD 
initiative  is  to  optimize  system  design  and 
manufacturing  processes.  Figure  42  shows  the 
future  vision  of  how  the  battlefield  is  tied  to 
the  factory  floor  by  the  IPPD  process.  With 
the  necessary  tools  and  communication  links. 
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Figure  42.  IPPD  (Source:  Defense  Science  Board) 


the  figure  emphasizes  the  "feed-back/feed- 
forward"  capabilities  among  the  various  envi¬ 
ronments  available  to  enhance  decision 
making.  Work  has  already  been  done  by  DOD 
to  transform  this  vision  into  reality.  The  ARPA 
is  encouraging  the  development  of  affordable 
tools  and  technologies  to  support  IPPD.  Addi¬ 
tionally,  being  develop>ed  are  communication 
standards  and  formats  for  a  broad  range  of 
M&S  tools  that  must  function  harmoniously 
to  achieve  the  vision. 

The  DSB  divides  production  and  logistics  into 
four  parts.  Discussed  below  is  a  summary  of 
DSB  comments  on  specific  M&S  tools  and 
tedinologies  for  manufacturing.  Virtual  pro¬ 
totyping  offers  great  potential  for  achieving 
affordable  weapons  systems  tailored  to  the 
specific  needs  of  warfi^ters. 


The  Vision 

The  DSB  vision  of  IPPD  covers  the  decade  of 
the  1990s  and  reflects  the  capabilities  ffrey  be¬ 
lieve  are  achievable  during  ttris  period  to  sup¬ 
port  versatile  and  cost-effective  engineering 
and  manufacturing  processes.  Expanded  ap 
plications  of  M&S  will  accelerate  the  full  im¬ 
plementation  of  IPPD.  The  DSB  expects  M&S 
will  progress  in  different  stages  for  the  vari¬ 
ous  sectors  of  the  industrial  base  during  the 
next  three  to  five  years.  The  ARPA  has  tar¬ 
geted  funds  for  the  critical  areas  of  this  proc¬ 
ess.  Various  tools,  some  existing  while  others 
need  to  be  developed,  will  substantially  affect 
IPPD  implementation.  The  DSB  is  corffident 
weapon  system  concepts  will  be  developed, 
tested  and  evaluated  using  simulation  with 
minimum  essential  prototype  fabrication  and 
physical  test  and  ev^uation  in  the  future.  Dis- 
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tributed  interactive  battlefield  simulation  will 
play  an  important  role  in  IPPD  implementa¬ 
tion.  The  9MNET  will  allow  warfighters  to 
assess  the  value  of  new  weapon  systems  and 
technologies  in  the  combined-force  battlefield 
envirorunent.  This  distributed  interactive 
simulation  capability  will  be  complemented 
by  real-time  hardware  and  warfighter-in-ttie- 
loop  engineering  simulations  to  bridge  the 
gap  between  the  current  engineering  design 
environment  and  the  new  synthetic  battlefield 
environment. 

The  DSB  sees  the  engineering  M&5  capabili¬ 
ties  that  will  be  developed  and  implemented 
during  the  decade  as  a  critical  element  in  the 
IPPD  process.  Improved  fimdamental  under¬ 
standing  of  the  manufacturing  process  gained 
from  modeling  research  will  enhance  the  abil¬ 
ity  to  optimize  manufacturing  processes  for 
specific  applications.  Trade-off  analysis  of  fac¬ 
tory  capability  can  provide  an  accurate  as¬ 
sessment  of  production  costs  to  enter  into 
full-scale  development  of  candidate  weapon 
systems.  Finally,  die  engineering  M&S  tools 
developed  during  the  decade  will  permit 
maintainability,  reliability  and  related  sup- 
portability  specialists  to  participate  in  the 
weapon  system  design  process  at  the  very  be¬ 
ginning,  permitting  supportability  to  be  de¬ 
signed  into  the  product. 

The  ARPA  and  the  U.S.  Army  have  already  in¬ 
itiated  projects  in  warfighter-in-the-loop  engi¬ 
neering  simulations  to  emulate  die  costly  and 
time-consuming  conventional  process  of  de¬ 
sign,  fabrication  and  testing.  Warfighter-in- 
the-loop  engineering  simulations  are 
intended  to  support  engineering  performance 
simulation  at  a  design  level  of  detail  and  as¬ 
sist  the  quantification  and  measurement  of 
human  response.  The  goal  is  to  create  the 
level  of  realism  required  for  the  weapon  sys¬ 
tem  simulations  to  function  effectively  in  die 
hands  of  a  broad  cross  section  of  warfighters. 
Along  with  carefully  plarmed  hardware- 


based  experiments  for  simulation,  validation 
and  parameter  determination,  a  fundamental 
understanding  of  critical  engineering  trade¬ 
off  using  virtual  prototypes  is  anticipated. 

Current  Needs 

The  DOD  Manufacturing  Technology  (Msm- 
Tech)  Program  sponsors  research  aimed  at  de¬ 
veloping  new  and  innovative  manufacturing 
technology  and  advanced  manufacturing 
processes  for  more  economical,  timely  and  re¬ 
liable  production  of  defense  products.  A  task 
force  was  created  in  1991  to  develop  a  strate¬ 
gic  plan  for  allocating  ManTech  investments. 
The  plan  would  be  more  responsive  to  shift¬ 
ing  economic  priorities  and  advancing  tech¬ 
nologies.  The  task  force  discussed  the: 

— Need  for  DOD  to  continue  providing  in¬ 
creased  flexibility  and  enhanced  capabili¬ 
ties  in  the  face  of  reduced  funding 

— Need  to  ensiue  next  generation  weapons 
systems  would  be  developed  in  a  timely, 
cost-effective  manner 

—  Identification  of  which  manufacturing  tech¬ 
nologies  should  be  optimized  to  yield  the 
highest  return  for  EXDD  investment 

Within  these  guidelines  the  task  force  also 
sought  to  identify  those  manufacturing  costs 
that  are  expected  to  consume  a  major  share  of 
defense  procurement  expenditures  over  the 
coming  decade.  They  want  to  iuentify  manu¬ 
facturing  technologies  that  a'.e  obstacles  to  ef¬ 
fective  production. 

The  analysis  suggested  sigt\iffcant  gait«  could 
be  achieved  by  expanding  efforts  to  indude 
soft  manufacturing  support  costs  such  as  pro¬ 
duction  management  and  manufacturing  en¬ 
gineering.  For  example,  a  breakdown  of 
electronic  purchased  parts  resulted  in  identi¬ 
fying  fabrication,  assembly  and  inspection  as 
the  dominant  cost  drivers  among  imit  proc- 
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Figure  43.  Priority  Scores:  the  Overall  Survey 


esses  required  to  manufacture  these  parts  <md 
subassemblies.  The  major  recommendation  of 
the  task  force  was  that  more  attention  needed 
to  be  focused  on  identifying  technical  devel¬ 
opments  in  those  areas. 

The  study  consisted  primarily  of  intensive  on¬ 
site  interviews  to  collect  information  on  the 
costs  of  assembly  processes,  assembly  sup¬ 
port  and  information  systems  along  with  data 


on  technological  opportunities  and  inhibitors. 
Based  on  this  data,  the  study  developed  the 
data  contained  at  Figure  43  which  provides  a 
quantitative  assessment  considering  the  im¬ 
portance,  need  and  cost.  The  activities  offer¬ 
ing  the  greatest  opportunities  for  payback 
were  design  for  assembly  (DFA)  and  assem¬ 
bly  plaiming.  Other  assembly-related  func¬ 
tions  such  as  statistical  process  control, 
quality  management,  material  flow  manage- 
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Avoid  Costly  Mistakes 


Using  desktop  manufacturing  techniques,  design  changes  can  be  made 
earlier  in  the  cycle  (during  verification)  when  they  are  less  expensive. 

Co.tot 


Drawing  Varlficatlon  Procats  Manufacturing  Final  After 

Board  Planning  Engineering  Production  Field 

Source:  Edieon  Malerlait  Teclmology  Center  Failun 


Figure  44.  Costs  of  Design  Changes 


ment,  and  assembly  systems  planning  are 
also  important.  The  constant  thread  running 
through  these  areas  is  the  need  to  develop 
systems  to  facilitate  the  coordination  of  de¬ 
sign,  assembly  and  quality  binctions  in  order 
to  deliver  manufactured  products  on  time, 
within  budget,  and  to  acceptable  performance 
measures.  This  backdrop  emphasizes  the  im¬ 
portance  of  design  in  the  manufacturing  proc¬ 
ess.*  The  principal  initiatives  underway  to 
address  these  problems  are  concurrent  engi¬ 
neering  and  flexible  automation. 

Concurrent  Engineering  and  Production 
The  objective  of  concurrent  engineering  is  to 
accelerate  all  phases  of  product  development 
by  starting  them  as  soon  as  possible  and  run¬ 
ning  them  concurrently.  Using  computer 


models  made  available  to  many  functional 
groups  working  in  parallel  eariy  in  the  design 
process,  concurrent  engineering  allows  de¬ 
sign  changes  before  producing  tooling  or 
products  thereby  merging  design,  production 
and  reliability  considerations.  The  data  in  Fig¬ 
ure  44,  courtesy  of  the  Edison  Materials  Tech¬ 
nology  Center,  a  materials  and  processing 
consortium  based  in  Dayton,  Ohio,  under¬ 
scores  the  savings  that  can  be  derived  by 
making  design  changes  early.^^  In  addition, 
designs  are  intended  to  produce  items  that 
can  be  economically  assembled  witii  existing 
capabilities.  The  impact  can  be  significant  be¬ 
cause  "over  70%  of  product  cost  is  committed 
at  tire  design  stage,"  according  to  respondents 
to  the  ManTedt  survey.*  The  key  message  of 
the  study,  particularly  for  DOD  contractois. 
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was  that  regardless  of  past  or  present  suc¬ 
cesses,  investments  in  DEA  activities  have  not 
been  sufficient  to  realize  the  full  benefits  of 
this  technology.  As  noted  in  Chapter  5,  conv 
panics  like  Boeing  and  Kohler  that  have  har¬ 
nessed  this  technology  are  achieving 
significant  competitive  advantage. 

The  impact  of  designing  the  product  for  as¬ 
sembly  not  only  reduces  the  number  of  parts 
but  2ilso  simplifies  all  the  related  support 
functions  of  materials  management,  inven¬ 
tory  control,  and  even  accounting  and  pur¬ 
chasing  procedures.  Product  design  for 
automated  assembly  often  results  in  a  design 
that  makes  manual  assembly  straightforward 
with  the  predominant  role  of  the  operator 
shifting  to  a  monitoring  and  quality  manage¬ 
ment  role.  The  design  of  tools  for  ease  of  as¬ 
sembly  brings  into  play  the  role  of 
ergonomics  and  its  basic  impact  is  the  crea¬ 
tion  of  a  safer,  more  reliable  work  environ¬ 
ment.  Design  for  product  supportability 
forces  consideration  of  the  life-cycle  aspects  of 
manufacturing  including  issues  such  as  main¬ 
tainability  and  reliability.  Fiiwlly,  design  of  the 
process  for  ease  of  assembly  forces  the  inte¬ 
gration  of  product  and  process  persoimel  nur¬ 
turing  concurrent  engineering.  Activities  that 
strive  to  eliminate,  reduce  or  at  least  incorpo¬ 
rate  production  constraints  within  the  design 
process  are  destined  to  significantly  impact 
the  assembly  cost  and  manufacturing  in  gen¬ 
eral. 

The  DARPA  Initiative  in  Concurrent  Engi¬ 
neering  (DICE)  is  addressing  many  concur¬ 
rent  enghieeiing  obstacles.  One  of  the 
principal  challenges  is  the  difficulty  of  ena¬ 
bling  designers  to  work  in  parallel.  Typically, 
participants  in  military  time-aitical  design 
processes  cross  many  disciplines,  including 
users,  designers,  engineers  and  frequently 
geographically-dispeised  manufacnirers.  The 
AREA  Collaborative  Environment  for  Con¬ 
current  Engineering  E)esign  (CECED)  en¬ 


compasses  new  methods  to  facilitate  com¬ 
munication  between  these  participants.  The 
goal  of  this  program  is  to  create  a  collabora¬ 
tive  environment  conducive  for  concurrent 
engineering.  Figure  45  shows  how  this  envi¬ 
ronment  would  be  used.^’ 

Concurrent  engineering  offers  a  number  of 
significant  benefits  over  current  practices.  See 
Rgure  46.  It  promotes  participation  on  an 
equal  footing  of  all  personnel  involved  in  the 
product.  Operating  in  a  collaborative  environ¬ 
ment,  players  communicate  using  familiar 
tools  and  address  concerns  while  the  oppor¬ 
tunity  still  exists  to  make  changes.  It  aids  pro¬ 
gram  management  and  administration  by 
forcing  a  dialogue  among  all  affected  parties 
and  permits  a  comprehensive  assessment  of 
the  total  product.  The  likelihood  parts  won't 
fit  or  interferences  occur  is  greatly  diminished 
in  a  collaborative  envirorunent.  It  allows  the 
exploitation  of  the  information  and  technol¬ 
ogy  explosion  that  is  expected  to  continue  in 
thel990s.^‘’ 

Concurrent  Engineering  and  Reliability 
Concurrent  engineering  benefits  will  extend 
throughout  the  product  life  cycle,  as  the  de¬ 
signed-in  reliability,  maintainability,  produd- 
bility  and  environmental  considerations  will 
result  in  reduced  maintenance,  spares  and 
disposal  parts.  Simulations  over  the  life  cyde 
of  parts  will  provide  accurate  data  that  pre¬ 
cludes  the  manufacture  of  a  flawed  design, 
predpitating  failures  months  or  years  later.41 
A  corollary  benefit  is  the  ability  to  identify 
over-designed  parts.  It  may  not  be  necessary 
to  design  a  component  to  last  20  years  when 
the  system  need  only  last  for  several  years. 

The  bottom  line  is  that  concurrent  engineer¬ 
ing  when  properly  implemented  will  produce 
items  which  incorporate  state-of-the-art  tech¬ 
nology  to  satisfy  customer  needs  and  manu¬ 
facturing  capabilities.  It  is  being  implemented 
successfully  and  is  a  prerequisite  to  being 
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Figure  45.  Concurrent  Engineering  Environment  (Source:  ARPA) 


•  Promotes  participation  on  an  equai  footing 

■  Piayers  use  appropriate  and  familiar  tools 

■  Concerns  are  addessed  while  the 
opportunity  for  change  still  exits 


•  Aids  program  management  and  administration 


•  Permits  comprehensive  snapshot  assessment  of 
total  vehicle  concept  for  more  informed  decisions 


•  Allows  exploitation  of  the  “Information  and 
Technology  Explosion/’  which  is  guaranteed  to 
happen 


Figure  46.  Benefits  of  Concurrent  Engineering 
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competitive  in  the  future.  Companies  not  em¬ 
bracing  concurrent  engineering  during  the 
1990s  will  find  it  increasingly  difficult,  if  not 
impossible,  to  compete. 

Flexible  Automation 

The  concept  of  a  flexible  manufacturing  envi¬ 
ronment  presents  a  number  of  opportunities. 
It  can  be  used  by  a  company  for  rapid  proto¬ 
typing,  moving  swiftly  from  a  market-gener- 
ated  demand,  through  design  and 
manufacturing  analysis  to  the  factory  floor 
and  ultimately  to  the  consumer.  It  can  be  em¬ 
ployed  to  enhance  a  company's  capability  to 
produce  military  and  commercial  products  in 
the  same  facility.  In  a  military  context,  it  can 
be  used  to  assess  manufacturing  suige  capa¬ 
bilities.  The  underlying  objective  is  to  obtain 
highly-flexible  and  integrated  manufacturing 
capability  designed  to  respond  quickly  to  a 
broad  range  of  customer  requirements.  The 
concept  of  flexible  automation  embraces 
equipment  and  people.  Flexibility  is  a  critical 
building  block  of  rapid  prototyping  and  the 
concept  of  a  virtual  factory. 

Rapid  Prototyping 

In  the  prototyping  world,  the  operative  word 
is  speed:  the  faster  you  can  design  and  opti¬ 
mize  a  conceptual  model,  the  sooner  you  can 
produce  and  ship  to  market.  Achieving  a 
quick  turnaround  is  not  easy  using  conven¬ 
tional  methods  but  with  the  help  of  rapid  pro¬ 
totyping  systems,  also  called  desktop 
manufacturing,  free-form  manufacturing  and 
3-D  printing  systems,  prototypes  can  be  pro¬ 
duct  in  a  sniall  fraction  of  the  time  and  at 
minimum  costs.  Rapid  prototyping  lets  com¬ 
panies  transform  computer-aided  design 
(CAD)  data  directly  into  parts  and  models 
without  ever  going  to  the  machine  shop.  Re- 
quiiing  an  investment  of  $3(X),000  to  $500,000, 
companies  rapidly  transform  CAD  drawings 
into  parts  and  models.  The  benefit  is  a  30-95 
percent  reduction  in  development  time  and 
cost.*^  Figure  47  describes  rapid  prototyping 


methods,  cost  and  capabilities  for  the  various 
commercial  processes. 

How  much  does  it  cost  a  company  to  produce 
a  benchmark  part  using  today's  rapid  proto¬ 
typing  tools?  Chrysler's  Jeep  and  Truck  Engi¬ 
neering  group  compared  he  costs  of  six  rapid 
prototyping  systems  by  producing  the  same 
benchmark  part,  a  speedometer  adaptor.  The 
systems  included  the  SLA-250  Stereolithogra¬ 
phy  Apparatus,  produced  by  3-D  Systems, 
Inc.  discussed  elsewhere  in  this  report.  Note 
that  the  total  part  costs  ranged  from  $92.23  to 
$378.10.  See  Figure  48.^^  It  should  be  noted 
that  companies  need  not  buy  the  equipment. 
Numerous  service  bureaus  exist  that  will  ac¬ 
cept  ".STL"  files,  the  de  facto  standard  format 
developed  by  3-D  Systems,  and  produce  pro¬ 
totypes.  The  data  at  Figure  49  compares  the 
total  time  required  to  make  the  part  using  the 
various  systems  including  preprocessing  and 
postprocessing  time.^ 

In  design  engineering,  the  systems  can  pro¬ 
vide  quick  conceptual  models  or  actual  proto¬ 
types  for  design  reviews.  They  can  enable 
engineers  to  execute  form,  fit  and  function 
tests;  however,  since  they  are  not  made  out  of 
the  material  with  which  they  will  be  pro¬ 
duced,  they  may  not  work  like  the  actual  part. 

The  parts  can  be  used  in  manufacturing  be¬ 
cause  the  physical  models  show  the  complex 
geometry  assisting  produdbility  studies.  Pro¬ 
totypes  can  also  function  as  finished  parts. 
They  can  be  patterns  for  investment  castings 
and  can  make  uretixane,  rubber  or  epoxy 
molds  to  cast  parts  of  varying  materials,  ^me 
manufacturers  say  their  parts  can  play  an  im¬ 
portant  role  in  marketing,  especially  to  en¬ 
hance  client  presentations.  They  can  also  be 
useful  in  purchasing  by  increasing  the  accu¬ 
racy  of  bids  received  by  including  physical 
models  as  part  of  the  bid  package. 
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Costs  to  Make  Benchmark  Part 


VARIABLES 

LOMIOAtS/ 

Hoiiaya 

Sintaraladon 

2000/OTII 

SoUdw5600/ 

Cubital 

SLA-25IV 

30Systams 

SLA-500/ 

30Syatams 

3D  Modular/ 
Skataaya 

Cost  of  aquipmant 

$85,000 

$397,000 

$490,000 

$210,000 

$420,000 

$182,000 

Expactad  Ufa/Yra. 

11 

11 

11 

11 

11 

11 

Sarvica  Contract 
Expan  aa 

$17,000 

$68,000 

$49,000 

$36,000 

$85,000 

$7,000 

PartExpanaa* 

$92,23 

$175.49 

$378.10 

$112.59 

$147.04 

$154.07 

‘Includes  depreciation,  material,  labor  and  overhead  costs. 


Source:  Chryalar’s  JMp  and  Truck  Engiiwcring 


Figure  48.  Parts  Cost 

Biomet  Inc,  Warsaw,  Ind,  designs  and  manu-  move  a  design  from  the  idea  stage  to  the  op- 
factures  health-care  products  for  orthopedic  eratingroom. 
surgeons.  Its  success  hinges  on  its  ability  to 
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Figure  49.  Hme  Required  to  Fabricate  Parts 
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Critical  success  ftctors  (6r  succeeding  at  rapid  evoludonaiy 
developfflefrtare: 

•  A  committed  and  informed  executive  sponsor 

•  An  operating  sponsor-a  champion 

•  Appropriate  IS  staff 

•  Appropriate  technology 

•  Management  of  data 

•  A  clear  link  to  business  objectives 

•  Management  of  organizational  resistance 

•  Management  of  system  evolution  and  spread. 

Figure  50.  Rapid  Prototyping  Organizational  Challenges  (Source:  Computerworld) 


In  1990,  Biomet's  model  shop  spent  2,000 
hours  crafting  models  to  support  11  new  pro¬ 
jects.  Machinists  used  manual  and  numeri¬ 
cally-controlled  machines  to  construct  each 
model  from  rough  bar  stock.  Company  offi¬ 
cials  could  see  the  impact  of  rapid  prototyp¬ 
ing  within  other  manufacturing  industries 
and  decided  to  invest  in  it. 

'We  looked  at  several  rapid  prototyping 
technologies,'  says  John  Amber, 
Biomet's  CAD /CAM  manager,  'and  de¬ 
cided  Stiatasys'  Fused  Deposition  Mod¬ 
eling  process  best  fit  our  needs.'  The 
company  brought  Stratasys  3-D 
Modeler,  setting  it  up  right  next  to  the 
CAD  workstation  in  the  office.  Typically, 
models  are  built  off  CAD  data  in  less 
than  an  hour.  Accuracy  is  +  or  -  0.005 
inch  over  a  12-inch  cubed  working  enve¬ 
lope.  The  company  estimates  the  3-D 
Modeler  will  cut  model-making  time  by 
200%  to  600%,  allowing  it  to  complete  50 
projects  scheduled  for  the  year. 


More  prototyjTes  faster  is  only  one  benefit: 
Biomet  has  used  Stratasys'  investment  casting 
wax  for  direct  output  to  the  investment  cast¬ 
ing  process.  Small  quantity  production  runs 
are  now  cast  without  expensive  hand  tooling. 

'Moving  from  11  new  products  in  1990 
to  50  in  1991  would've  been  impossible 
without  the  kind  of  productivity  boost 
this  technology  has  delivered,'  accord¬ 
ing  to  Farry  England,  Biomet  vice  presi¬ 
dent  of  manufacturing.  'Introducing  the 
Stratasys  system  will  allow  us  to  meet 
aggressive  production  goals  and  to  sus¬ 
tain  our  record  growth.' 

Rapid  prototyping  techniques  are  being  used 
increasingly  by  large  U.S.  manufacturers  but, 
overall,  analysis  say  this  technology  is  still  in 
its  infancy.  Major  European  and  Japanese 
companies  are  working  with  the  prototyping 
technology,  tailoring  it  and  expeinding  its 
uses.  Analysts  say  most  of  the  large  Japanese 
elecbonics  companies  and  automakers,  for  in- 
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•  Open  Architectures 

•  Scalable  Architectures 

•  Windowe4>ased  interfaces 

•  Distributed  Databases 

•  Fourth  Generation  Language 


Figure  51.  Rapid  Prototyping  Technological  Challenges  (Source:  Modem  Office 
Technology) 


stance,  now  use  some  kind  of  rapid  prototyp¬ 
ing  procedures. 

Successful  implementation  of  rapid  prototyp¬ 
ing  requires  organizational  commitment  and 
application  of  several  key  technologies.  The 
key  organizational  factors  for  suocee^ng  with 
rapid  prototyping  are  listed  in  Figure  50.  Note 
the  importance  of  executive  and  operational 
sponsorship.  A  clear  link  must  be  established 
to  business  objectives,  and  management  must 
be  prepared  to  deal  with  organizational  resis¬ 
tance.  Additionally,  an  appropriate  informa¬ 
tion  systems  staff  is  critical,  along  with 
technology  and  data  management.^  The  key 
technological  capabilities  have  been  in  place 
for  some  time;  however,  they  are  only  now 
being  applied  in  the  development  process  as 
shown  in  Hgure  51.  Open  architectures  allow 
for  the  use  of  multiple  vendor  platforms;  scal¬ 
able  architectures  supprort  multidimensional 
growth  of  hardware  and  software  systems; 
window-based  interfaces  give  users  access  to 
multiple  applications  simultaneously;  distrib¬ 
uted  databases  allow  scaling  without  choking 
the  system;  and  fourth  generation  languages 
allow  tire  use  of  pseudo-English  tools  ^at  can 
be  manipulated  by  a  system  administrator 
rather  than  a  programmer.^^  These  challenges 
ate  being  met  today  by  companies  who  recog¬ 


nize  the  importance  of  speed  and  the  key 
competitive  advantages  derived  from  bring¬ 
ing  products  to  market  first. 

Virtual  Factory 

Modernization  pressures  and  the  astronomi¬ 
cal  costs  of  factory  design,  along  with  the  cost 
of  design  errors,  have  made  simulation  an 
attractive  planning  tool.  VNTrth  current  factory 
simulation  packages,  companies  can  model 
factories.  These  models  differ  sigrrificantly 
from  paper  models  becairse  they  can  simulate 
large  periods  of  time  unlike  a  snapshot  pro¬ 
vided  by  the  paper  method.  It  is  a  tool  that 
can  be  used  to  evaluate  the  feasibility  of 
adapting  flexible  assembly  in  a  particular 
plant.  It  allows  the  user  to  explore  a  full  range 
of  manufacturing  options  —  machinery,  new 
or  old;  personnel,  one  or  two  shifts;  and 
sourdng,  build  or  buy.  It  can  also  be  used  to 
determine  manufachiring  capacity  and  the 
feasibility  of  converting  from  commercial  to 
nrilitary  products  and  vice  versa. 

Factory  simulations  are  particularly  impor¬ 
tant  as  companies  grow  or  restructure.  The 
simulations  allow  companies  to  describe  ac¬ 
tivities  and  constraints  and  to  rapidly  evalu¬ 
ate  various  alternatives.  For  example, 
Schering  Corporation  performed  a  simulation 
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to  determine  if  its  pharmaceutical  factories 
could  meet  forecasted  demand.  The  company 
wanted  to  know  if  current  facilities  could 
handle  an  anticipated  upswing  in  production. 
They  needed  to  determine  if  new  capacity 
would  be  needed,  how  much  and  whether  it 
could  be  justified  financially.  The  simulation 
revealed  toat  even  two  shifts  a  day  would  fall 
short  of  anticipated  production  requirements. 

Once  understood,  the  company  worked 
through  four  new  factory  scenarios  before 
finding  an  optimal  solution.  This  type  of  long- 
range  evaluation  capability  has  enormous  po¬ 
tential  for  DOD  as  it  proceeds  with 
downsizing  and  restructuring.  A  virtual  fac¬ 
tory  simulation  capability  can  be  used  to  as¬ 
sess  die  impact  of  plant  closings,  calculate 
surge  capacity,  and  evaluate  the  feasibility  of 
dual  use  applications.^ 

Significant  Challenges 
The  DSB  has  identified  six  significant  issues 
regarding  the  use  of  M&S  in  the  engineering 
and  manufacturing  process. 

1,  Can  M&S  be  used  to  shorten  the  time  emd 
reduce  substantially  the  cost  of  conven¬ 
tional  prototype  fabrication  and  testing? 
The  DSB  concluded  that  the  judicious  use 
of  appropriate  M&S  methods,  concentrat¬ 
ing  on  critical  performance  and  manufac¬ 
turing  process  issues,  and  taking 
advantage  of  available  models  of  noncriti- 
cal  weapon  performance  and  manufactur¬ 
ing  capabilities  can  reduce  significantly 
the  time  and  cost  of  weapon  system  de¬ 
velopment. 

2.  What  is  capable  of  being  modeled  and 
simulated?  Many  aspects  of  weapon  sys¬ 
tem  performance  are  capable  of  being 
simulated  witii  confidence,  whereas  some 
performance-related  design  trade-offs  re¬ 
quire  real-time  interactive  warfighteiv 
and  hardware-in-the-loop  methods  not  in 


existence.  In  addition,  only  selected 
manufacturing  processes  can  be  modeled 
now  requiring  that  most  simulations  of 
manufacturing  processes  be  carried  out 
using  physical  experiments  or  empirical 
models  based  on  experimental  data. 

3.  What  should  be  modeled  and  simulated? 
Critical  weapon  system  performance  and 
manufacturing  process  characteristics 
should  receive  high  priority.  The  least 
cost  and  time-consuming  M&S  approach 
should  be  adopted  to  meet  specific  high 
priority  needs  in  product  and  process  de¬ 
sign. 

4.  Is  there  an  infrastructure  to  support  M&S? 
This  is  a  major  challenge  because  the  nec¬ 
essary  infrastructure  does  not  exist  Indi- 
vidud  discipline-oriented  simulation 
tools  exist,  but  most  are  embedded  in  spe¬ 
cialized  organizations.  Data  communica¬ 
tion  standards  and  tools  do  not  exist  to 
exploit  the  broad  range  of  tools  required 
in  weapon  system  and  manufacturing 
process  design. 

5.  Modeling  and  simulation  can  guide  selec¬ 
tive  investment  in  the  industrial  base. 
However,  models  of  the  base  do  not  exist, 
and  it  is  uncertain  if  such  a  capability  is 
feasible  in  the  future. 

6.  Should  M&S  be  used  as  a  source-selection 
tool?  Many  sectors  of  the  industrial  base 
capable  of  M&S  are  capable  of  using  M&S 
as  a  discriminator.  TTie  DSB  suggested 
that  the  use  of  M&S  in  source  selection  be 
expanded. 

The  significant  competitive  advantag;;s  of¬ 
fered  by  concurrent  engineering  and  rapid 
prototyping  have  compelled  commercial 
firms  to  embrace  the  tedinologies  and  make 
organizational  changes  necessary  to  realize 
these  benefits.  The  DOD  should  be  able  to 
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achieve  these  same  benefits  in  its  weapon  sys¬ 
tems  acquisition  if  it  maximizes  the  use  of  the 
technology  in  its  acquisition  process.  Acquisi¬ 
tion  strat^es,  acquisition  plans,  requests  for 
proposal,  source-sdection  plans  and  MS  crite¬ 


ria  need  to  incorporate  the  concept  of  virtual 
prototyping  as  a  fundamental  element.  That 
is,  virtual  prototyping  should  be  the  printary 
or  central  feature  bridging  all  phases  of  the 
acquisition  process. 
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What,  sir,  would  you  make  a  ship  sad  against  the  wind 
and  currents  by  lighting  a  bonfire  under  her  deck?  I  pray 
ou  excuse  me.  I  have  no  time  to  listen  to  such  nonsense. 

—  Napoleon  to  Robert  Fulton 


Chapter  5 

EXAMPLES  OF  SYNTHETIC 
ENVIRONMENTS 


One  objective  of  this  research  project 
was  to  identify  and  assess  the  current 
applications  of  virtual  prototyping 
by  commercial  companies,  defense  contrac¬ 
tors  and  universities.  This  chapter  highlights 
the  significant  applications  we  foimd  diuing 
our  research.  The  examples  include  applica¬ 
tions  on  laige  defense  and  commercial  sys¬ 
tems  at  General  Dynamics,  Sikorsky  and 
Boeing.  It  includes  small,  commercial,  four¬ 
cycle  engines  developed  and  manufactured 
by  Kohler,  as  well  as  research  efforts  at  the 
Army's  Night  Vision  and  Electronics  Sensors 
Directorate,  the  Uruversity  of  Washington, 
and  the  University  of  North  Carolina.  CXn 
discussion  documents  the  highlights  of  an  on¬ 


site  survey  of  the  utility  of  virtual  prototyping 
in  a  broad  range  of  applications. 

BOEING  AIRCRAFT  COMPANY 
The  Boeing  777  aircraft  is  being  designed  and 
built  in  a  radically  new  fashion.  See  Figure  52. 
Using  2,200  workstations,  eight  IBM  main¬ 
frames  and  IBM's  CATIA  CAD/CAM  soft¬ 
ware,  at  a  cost  of  roughly  $100  million,  the 
company  is  designing  the  777  aircraft  entirely 
on  paper  and  plans  to  build  it  without  a 
physical  mock-up.  The  777  aircraft  has  85,000 
components  and  more  than  4  million  parts. 
Boeing's  goal  is  to  make  it  the  timeliest  and 
most  trouble-free  program  the  company  has 
ever  undertaken.'  Some  refer  to  it  as  a  paper- 


Figure  52.  Boeing  Til  Aircraft 
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Figure  53.  Boeing  TTJ  Design  Quality 


less  aircraft  but,  "not  so,"  according  to  Boe-  keting  management  the  single  biggest  prob¬ 
ing  senior  offidab  who  said  that  while  they  lem  in  industrial  manufacturing  is  simply  that 
are  relying  on  computer  tools,  customeis  will  parts  don't  fit  "We  used  to  build  an  entire 
receive  the  same  manuals  and  other  aircraft  plane  just  to  find  out  if  the  parts  fit.  What  a 
documentation  they  now  receive.  Boeing  waste  of  money."  ^  The  company  checked  the 
adopted  a  digital  design  approach  for  three  process  itself  by  designing  and  part-checking 
reasons:  one  section  of  ^e  aircraft  and  then  building  a 

mock-up  of  that.  "The  result  was  wonderful. 
1.  Cost  savings:  The  company's  goal  is  to  Almost  perfect!"  This  from  a  Boeing  chief  en- 
manufacturo  the  777  aircraft  wift  the  gineer  who  oversaw  the  mock-up.  The  only 
same  number  of  manufacturing  hours  it  problem  was  three  cable  bundles  were  a  bit 
took  to  produce  the  767  aircraft  even  short.  Current  data  on  the  number  of  design 
though  the  777  has  an  empty  wei^t  57  changes  also  bears  this  out.^  The  company  is 
percent  greater  than  the  767  aircraft^  The  experiendng  a  93  percent  reduction  in  design 
777  aircraft,  first  scheduled  for  delivery  in  changes  compared  with  design  changes  in 
1995,  is  designed  to  carry  375-400  passen-  previous  aircraft  Early  in  the  assembly  proc- 
gers,  wiOi  an  initial  range  of  4,000  nauti-  ess,  this  is  a  truly  remarkable  achievement, 
cal  miles  while  the  767,  first  delivered  in  The  data  in  Rgure  53,  provided  by  Boeing,  U- 
the  early  1980's,  carries  220-300  passen-  lustrates  this  trend, 
gers  wi^  a  range  of  6JKO  nautical  miles. 

Another  area  of  savings  is  in  tooling  costs. 
Boeing  plans  to  achieve  these  cost  savings  by  Previously,  it  was  necessary  to  physically 
designing  the  aircraft  so  its  parts  fit  together  trace  the  Sawings  of  the  airci^t  parts  around 
predsely  die  first  time,  thereby  reducing  the  whidi  die  tooling  would  be  designed.  Using 
number  of  design  changes  required.  Accord-  digital  design,  plaster  models  have  been  re- 
ing  to  Mr.  Joe  Ozimek,  chief  engineer  of  mar-  placed  widi  digital  data  gready  improving 
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the  precision  and  efficiency  in  building  tools. 
Virtual  prototyping  has  improved  the  accu¬ 
racy  of  tool  design  by  a  factor  of  ten.^ 

2.  Reduced  manufacturing  cycle  times: 
Digital  design  and  virtual  prototyping 
can  help  reduce  cycle  time.  Boeing 
wants  to  reduce  production  times  by 
more  than  50  percent  to  six  months  vs.  13 
montos.^  Among  toe  many  challenges,  of 
adapting  a  digital  design  approach  was 
overcoming  the  inertia  within  the  com¬ 
pany.  Digital  design  was  a  major  cultural 
change.  Drafting  tables  were  literally  re¬ 
placed  by  thousands  of  computer  work¬ 
stations.  From  the  beginning  Boeing  has 
planned  to  take  more  time  to  design  the 
777  aircraft  than  earlier  planes.  They 
adopted  digital  design  to  realize  signifi¬ 
cant  reductions  in  cyde  time,  but  they 
also  recognized  that  toe  transition  would 
be  difficult  and  time-consiuning.  They 
fully  expect  to  realize  dramatic  savings  on 
follow-on  projects. 

3.  Customer  satisfaction;  Boeing  has  sou^t 
input  from  their  customers  continuously 
during  the  777  design  process  and  they 
have  incorporated  numerous  design 
changes  to  meet  customer  needs.  Repre¬ 
sentatives  of  United  Aircraft,  Inc.,  the 
kick-off  customer  for  the  777  program, 
have  played  a  critical  role  in  toe  early  de¬ 
sign  of  the  aircraft. 

Changes  brought  about  by  customer  recom¬ 
mendations  included  making  a  hydraulic  ac¬ 
cumulator  smaller  and  lighter  since  the  airline 
did  not  need  the  12  hours  of  hydraulic  pres¬ 
sure  initially  platmed.  The  airiines  informed 
Boeing  they  couldn't  economically  afford  to 
have  a  plane  idle  for  that  long,  so  the  system 
should  not  be  overdesigned.  In  another  ex¬ 
ample,  trailing  edge  flaps  were  manufactured 
in  two  pieces  so  they  would  fit  in  the  auto¬ 
clave  used  by  United.  Boeing  modified  the 


push  buttons  used  to  pop  open  access  panels 
for  items  such  as  auxiliary  power  units  and 
air-conditiorung  packs  were  enlarged  to  allow 
a  medranic  wearing  gloves  to  activate  them.  ^ 

Boeing  also  tailors  an  aircraft's  features  to 
meet  specific  customer  requirements.  Seat 
configurations,  galley  capabilities,  engines, 
navigational  equipment,  fuel  capacity  and 
cargo-holding  capabilities  are  items  that  usu¬ 
ally  vary  by  customer.  No  two  planes  are  ex¬ 
actly  toe  same.  It  is  also  common  for  airlines 
over  time  to  modify  their  planes  in  response 
to  different  routes  and  market  conditions. 
Customizing  the  777  for  customers  will  be 
easier  in  the  future  because  Boeing  will  main¬ 
tain  the  digital  design  data  used  to  manufac¬ 
ture  each  aircraft.  This  digital  information 
will  be  used  in  any  redesign  or  customization 
efforts. 

Boeing  employed  238  design-build  teams  to 
design  the  777.  The  teams  included  produc¬ 
tion  personnel,  supplier  representatives,  air¬ 
line  workers  and  design  engineers.  The 
process  was  intended  to  end  toe  traditional 
isolation  of  disciplines  and  force  the  partici¬ 
pants  to  work  out  solutions.  Engineers  creat¬ 
ing  the  777  hydraulic  conduit  didn't  just 
assume  it  could  be  manufactured  for  $7,000; 
they  asked  the  supplier's  representative  on 
the  Boeing  team.® 

GENERAL  DYNAMICS  - 
ELECTRIC  BOAT  DIVISION  (GD/EBD) 

The  GD/EBD  in  Groton,  Conn.,  designs  and 
builds  toe  majority  of  the  U.S.  Navy's  most 
sophisticated  submarines.  The  magnitude  of 
tois  task  demands  computer  automation  be 
applied  not  only  where  it  is  cost-effective  in 
the  short  run,  but  where  long-term  advan¬ 
tages  can  be  anticipated  reasonably.  The 
GD/EBD  believes  the  greatest  potential  for 
cost  reduction  in  the  life-cycle  cost  of  a  system 
exists  during  toe  engineering  design  phase. 
Accordingly,  it  is  implementing  a  Production 


Examples  of  Synthetic  Environments  -  91 


Virtual  Prototyping:  Concept  to  Production 


Automated  Design  Process  (PADP)  widi  the 
goal  of  reducing  cycle  time  and  cost,  and  inv- 
proving  product  quality  by  integrating  die  en¬ 
gineering  design  process  and  manufacturing 
considerations  early  in  the  life  cyde.  Based 
on  the  latest  digital  design  concepts,  GD/EBD 
expects  to  reduce  substantially  the  cost  of 
submarine  design  and  construction  and  to  be 
able  to  integrate  PADP  with  proven  shipyard 
production  control  systems.  Electric  Boat  will 
implement  PADP  in  an  evolutionary  manner 
that  involves  a  commitment  :rom  top  man¬ 
agement,  extensive  training  and  a  continuous 
review  and  improvement  process.  The  chal¬ 
lenge  is  to  nrulintain  an  acceptable  balance  be¬ 
tween  short-term  additional  costs  and  long¬ 
term  cost  savings. 

Figure  54  shows  the  old,  time-proven  design 
process  at  GD/EBD  —  a  manual  design  tech¬ 
nology  that  results  in  a  life-size  physical 
mock-up  of  a  submarine.^  The  physical 
mock-up  serves  many  purposes,  for  example, 
physical  fit  of  component,  interference  and 
dearance  checking,  visualization,  production 
process  visualization,  and  drawing  conhrma- 
tion.  The  proven  physical  mock-up  is  then 
translated  into  electronic  format  and  stored  in 
a  drawing-oriented  database.  The  database  is 
used  to  generate  conventional  design  draw¬ 
ings  by  disdpline,  such  as  electrical,  struc¬ 
tural  and  fluid.  The  database  also  allows 
limited  computer  graphics  display  of  the  de¬ 
sign  and  the  generation  of  single  disdpline 
construction  drawings  for  the  various  sec¬ 
tions  of  the  submarine.  Detailed  production 
platuiing  and  the  generation  of  multidisd- 
plined  produd  structure  documents  is,  for  the 
most  part,  a  manual  process  which  relies 
heavily  on  the  physical  mock-up  for  visualiz¬ 
ing  and  understanding  the  complex  produd 
and  manufacturing  process. 

The  physical  mock-up  is  the  anchor  for  the 
design  process.  The  confidence  generated  in 
the  design  engineers  and  managers  by  the 


physical  mock-up  is  well  deserved  since  this 
approach  to  building  submarines  has  proved 
successful  in  the  past.  In  fact,  this  confidence 
is  so  strong  it  might  be  described  as  an  "im¬ 
pediment  to  change"  if  one  proposes  to  elimi¬ 
nate  the  physical  mock-up  from  the  design 
process! 

A  physical  mock-up  for  a  submarine  is  expen¬ 
sive  to  build  and  maintain.  It  must  be  built 
with  sufficient  precision  that  measurements 
taken  at  the  mock-up  can  be  relied  upon  dur¬ 
ing  construction  of  the  final  produd.  Finally, 
the  value  of  the  mock-up  in  allowing  engi¬ 
neers  to  visualize  the  product  cannot  be  dis¬ 
missed  lightly.  Replacing  the  mock-up  with  a 
virtual  prototype  will  require  time  and  train¬ 
ing  before  a  cultural  change  in  engineers  and 
managers  can  be  accomplished. 

During  our  visit,  GD/EBD  explained  how 
they  are  moving  to  a  new  design  process 
where  the  anchor  for  the  process  will  be  a 
parts-based  database  rather  than  a  drawing- 
oriented  database  derived  from  a  physical 
modc-up.  The  new  database  will  be  struc- 
hired  with  individual  parts  as  the  basic  ele¬ 
ments.  Attached  to  eadi  part  in  this  database 
is  all  the  information  needed  to  use  the  part  in 
a  design  —  description,  drawings,  sources, 
substitutions  and  engineering  characterishcs, 
such  as  weight,  electrical,  thermal  and 
strength,  for  example. 

As  parts  are  designed  or  selected  from  out¬ 
side  sources,  they  are  entered  into  the  data¬ 
base  and  become  available  for  reuse,  thus 
promoting  standardization  and  the  ability  to 
distinguish  between  parts  manufactured  to 
stock  and  parts  built  to  installation  require¬ 
ments.  The  design  process  results  in  building 
a  database  containing  all  the  information 
about  the  parts  in  the  submarine,  how  they 
are  associated  with  each  other,  and  how  they 
will  perform.  The  database  contains  reusable 
information  from  design  through  construc- 


92  >  Examples  of  Synthetic  Environments 


Figure  55.  Electronic  Design  Process  (Source;  General  Dynamics). 
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tion  and  supports  an  efficient  and  flexible 
medianism  for  product  changes. 

Having  a  global  database  that  contains  all  the 
design  information  and  using  an  integrated 
multidisciplinary  design  team,  concurrent  en¬ 
gineering  techniques  will  lead  to  a  reduction 
in  the  number  of  design  iterations.  A  concur¬ 
rent  engineering  team  at  GD/EBD,  shown  in 
Figure  55,  simultaneously  develops  the  prod¬ 
uct  and  the  related  production  processes. 
Sharing  knowledge  across  disciplines  and 
across  organizations  allows  early  identitica- 
tion  of  major  cost  drivers  and  allows  trade¬ 
off  studies  to  optimize  the  design  for 
acceptable  cost  The  GD/EBD  has  established 
the  following  fundamental  principles  for  im¬ 
plementing  concurrent  engineering: 

— Empower  cross-functional  design  and 
build  teams. 

—  Use  parallel  product  and  process  develof>- 
ment 

—  Integrate  all  scheduling. 

—  Involve  customers  and  suppliers  early. 

—  Minimize  life-cycle  costs. 

—  Develop  a  life-cyde  flow  chart 

—  Develop  a  risk-management  plan. 

—  Use  shared  databases  to  the  maximum. 

— Establish,  collect  and  evaluate  metrics. 

To  support  the  conversion  to  virtual  proto¬ 
types,  GD/EBD  has  a  visualization  center 
composed  of  a  secure  networic  of  CAD  work¬ 
stations,  computer  image  generators  and  a 
video  control  center  coupled  to  a  wall-sized 
color  projection  system.  \^rtual  prototypes 


can  be  displayed,  manipulated  and  modified 
rapidly  as  an  integrated  design  team  sorts  out 
major  issues.  One  significant  benefit  of  the 
virtual  prototype  is  the  ability  to  electroru- 
cally  check  for  interferences;  i.e.  two  compo¬ 
nents  occupying  the  same  space.  Because  it  is 
difficult  to  check  for  physical  interferences  us¬ 
ing  flat  2-D  paper  drawings,  expensive  physi¬ 
cal  mock-ups  must  be  built  to  exact 
spedfications  to  detect  interferences.  Under 
the  new  design  approach,  as  design  issues  are 
resolved,  changes  are  made  to  a  central  data¬ 
base  in  accordance  with  an  approval  proce¬ 
dure  that  maintains  configuration  control. 
Detailed  designs  are  then  created  by  each  dis- 
dpline  and  brought  to  the  next  team  meeting. 

This  cyde  of  iterative  design  work  continues 
until  the  product  converges  to  an  acceptable 
solution.  The  success  of  this  design  approach 
is  illustrated  by  the  following  results; 

—  A  30  percent  cost  reduction  in  the  design 
process  due  to  decreased  cyde  time 

—  Simplified  designs,  welding  requirements 
and  pipe  layout 

— Better  tool  design;  tools  can  get  into  tight 
spaces  during  manufacturing  and  assembly 

—  Properly  sequenced  plans  for  manufactur¬ 
ing  assembly 

—  Weight  study  preparation  time  reduced  by 
60  percent  compared  to  manual  methods 

—  Standardized  fasteners  witt\  a  reduction  in 
variations  of  62  percent 

—  Early  make-buy  decisions 

— Overall  schedules  and  management  of  criti¬ 
cal  paths  enhanced 
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— Estimates  for  component  lead  times  im¬ 
proved. 

In  addition,  specific  information  can  be  ex¬ 
tracted  from  the  parts  based  global  database 
to  satisfy  different  reqtiirements.  Drawings 
by  discipline  can  be  generated  with  little  or 
no  manual  intervention,  and  multidisdpline 
packages  for  each  module  or  section  can  be 
assembled.  Remote  terminals  can  be  located 
at  manufacturing  sites  for  easy  reference  to 
data  and  for  visualization  of  ^e  product  or 
the  assembly  process.  Finally,  a  virtual  proto¬ 
type  or  electronic  mock-up  can  be  generated 
from  the  database  at  a  much  lower  cost  and 
much  more  precision  than  a  physical  mock- 
up. 


SIKORSKY 

Sikorsky  Aircraft,  a  division  of  United  Tedi- 
nologies,  is  located  in  Stratford,  Conn.,  and  is 
one  of  the  major  helicopter  producers  in  the 
world.  In  addition  to  being  the  prime  con¬ 
tractor  for  tile  Army's  Blackhawk,  the  Navy's 
Sea  Stallion,  and  the  Marine  Corps'  Super 
Stallion  helicopters,  Sikorsky  is  one  of  the 
leaders  of  the  Boeing  Skorsky  Team  that  won 
the  demonstration  and  validation  contract  for 
the  Army's  newest  helicopter,  the  RAH-66 
Comanche.  The  Comanche  is  a  twin-turbine, 
two-seat  helicopter  that  is  being  designed  to 
perfoim  armed  reconnaissance,  light  attack 
and  air  combat  missions.  The  current  fund¬ 
ing  estimate  for  the  1991-97  demonstration 
and  validation  prototype  program  is  approxi¬ 
mately  $1.97  billion  and  three  flyable  proto- 
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Figure  56.  Use  of  Simulation  on  tite  Comanche  Program 
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types  are  being  designed,  built  and  tested 
during  this  phase.  The  Comeinche  is  the  cen¬ 
terpiece  of  the  Army's  new  Aviation  Modern¬ 
ization  Plan  that  was  released  early  in  1993. 
This  plan  reflects  the  Army's  new  post-Cold 
War  strategy  to  react  to  regional  conflicts  by 
using  fewer  personnel  and  long-range,  self- 
deployable  aircraft  that  are  based  in  the  conti¬ 
nental  United  States.  Key  design  features  of 
the  Comanche  include  low  observables,  im¬ 
proved  sensors,  increased  maneuverability, 
agility  and  speed,  and  reduced  supportability 
requirements.  The  Army  intends  to  use  the 
Comanche  to  replace  nearly  3,000  obsolete 
AH-1,  OH-6  and  OH-58  attack  and  observa¬ 
tion  helicopters.  A  full-scale  mock-up  of  the 
Comanche  is  shown  in  Color  Plate  5. 


Sikorsky  has  made  extensive  use  of  simula¬ 
tion  on  the  Comanche  program  and  will  par¬ 
ticipate  in  the  1993  demonstrahons  of  the 
electronic  battiefield  being  planned  by  DMSO 
and  STRICOM.  Sikorsky  has  connected  its  pi¬ 
loted  simulation  to  SIMNET  and  will  use  this 
medium  to  engage  in  simulated  battle  with 
other  weapon  systems.  In  Figure  56,  Sikorsky 
highlights  the  past  and  propxrsed  uses  of 
simulation  in  the  Comanche  life  cycle. 

The  Comanche  simulation  facility  capabilities 
are  extensive  and  extremely  impressive.  The 
facility  represents  an  investment  of  approxi¬ 
mately  $25  million.  The  equipment  is  state  of 
the  art  with  a  visual  simulator  that  uses  a 
lai^e  number  of  parallel  processc'rs  to  mini¬ 
mize  time  to  compute  the  visual  s  :ene.  There 
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is  no  percetible  lag  between  a  control  move¬ 
ment  and  a  change  in  the  visual  scene.  Figure 
57  illustrates  the  complexity  and  highly  inte¬ 
grated  nature  of  the  Comanche  Full  Mission 
Simulation  (FMS).  The  FMS  is  a  high-fidelity 
representation  of  the  aircraft  design,  includ¬ 
ing  the  air  vehicle,  mission  equipment  pay- 
load  and  armament,  that  operates  in  real-time 
as  a  crew-in-the-loop  simulation.  The  simula¬ 
tion  contains  interactive  software  on  board 
the  aircraft  to  simulate  locating  threats  and 
being  located  by  threats.  Appropriate  stimuli 
are  included  also  to  address  crew  workload 
requirements  such  as  radio  communication 
and  team  coordination  in  mission-oriented 
scenarios.  The  simulation  includes  many  fac¬ 
ets  of  a  mission  like  weather  effects,  time  of 
day,  and  subsystem  conditions.  The  simula¬ 
tion  facility  also  includes  a  data  collection  ca¬ 
pability  for  recording  parameters  of  per¬ 
formance  and  effectiveness. 

The  simulator  supports  design  iterations  of 
the  crew  station  cockpit  by  being  able  to 
evaluate  the  performance  of  prototype  de¬ 


signs  in  a  realistic  environment.  It  will  be 
used  to  develop  flight  control  laws  and  assess 
aircraft-handling  qualities  with  respect  to 
specification  requirements.  Additional  uses 
include  generation  of  data  to  supjx)rt  trade¬ 
off  studies  and  defining  the  detailed  elements 
of  ffie  pilot  vehicle  interface  spedficaHon. 
Human  factor  assessments  of  crew  woddoad 
in  mission-oriented  scenarios  will  be  sup¬ 
ported  by  this  facility  as  well.  It  will  be  used 
for  verification  and  validation  of  the  flight 
control  computer  software,  training  of  Army 
and  contractor  pilots  and  for  prototype  flight 
test  development.  As  described  above,  Sikor¬ 
sky  and  the  government  intend  to  make 
nmximum  use  of  the  Comanche  virtual  proto¬ 
type  during  the  development  process.  Fig¬ 
ures  58  and  59  illustrate  the  projected  cost 
benefit  relationship  of  simulation  in  the  Co¬ 
manche  program. 

Sikoisky,  like  other  major  airframe  manufac¬ 
turers,  uses  CAD/CAM  tools  and  has  experi¬ 
ence  with  digital  design  techniques. 
According  to  Sikorsky's  program  manager  for 
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the  Boeing  Sikorsky  Comanche  Team,  "There 
isn't  a  drawing  board  in  the  building.  Every¬ 
one  is  designing  things  on  tubes."  “  Sikorsky 
is  one  of  the  first  companies  to  rely  almost  ex¬ 
clusively  on  IBM  workstations  instead  of  us¬ 
ing  mainframe  computers  to  run  CATIA 
software.  Joseph  Piteo,  director  of  engineer¬ 
ing  automation  at  Sikorsky,  believes  that  engi¬ 
neers  on  the  Comanche  are  "accomplishing 
things  with  computer  technology  that  simply 
could  not  be  done  with  traditional  methods. 
The  full-scale  electronic  mock-up  of  the  air¬ 
craft,  for  example,  could  never  have  been 
done  as  thorou^dy  in  aluminum  and  steel  or 
updated  with  such  ease  in  real  time." 

Concurrent  engineering  is  being  employed  at 
Sikorsky  and  the  digit^  design  process  now 
allows  engineers  to  go  through  numerous  (50, 
for  example)  design  iterations  where  pre¬ 
viously  they  were  restricted  to  doing  just  a 
few,  using  traditioncd  methods.  Eugene  Budc- 
ley,  Sikorsky  President  and  Chief  Executive 


Officer,  believes  this  design  capability  pro¬ 
vides  engineers  with  a  way  to  miiumize  ^eir 
designs  cost  and  also  reduce  the  manpower 
required  for  design  production.  According  to 
data  from  the  CH-53E  Super  Stallion  pro¬ 
gram,  it  took  38  draftsmen  approximately  six 
months  to  produce  the  worl^g  drawings  of 
the  aircraft's  outside  contours.  The  same  task 
on  the  Comanche  program  can  be  accom¬ 
plished  by  one  engineer  in  one  month.  In  ad¬ 
dition,  precisely  designed  parts  go  togedrer 
well  the  first  time  and  thus  require  a  mini¬ 
mum  amount  of  rework.  Sikorsky's  faith  in 
workstations  is  illustrated  vividly  by  the  fact 
that  1,700  of  the  2,500  engineers  already  have 
a  workstation  or  personal  computer  on  their 
desk.’^  The  following  pictures  illustrate  Sikor¬ 
sky's  use  of  these  design  tools. 

Another  key  feature  of  the  computer  capabil¬ 
ity  being  employed  by  the  Boeing  Sikorsky 
Comanche  Team  is  the  ability  to  electronically 
pass  designs  between  the  various  team  mem- 
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here.  Design  changes  for  subsystems  and  tained  in  the  field  using  the  same  software 
components  being  developed  by  subcontrac-  that  is  being  used  to  design  the  aircraft, 
tors  are  transmitted  daily,  reviewed  by  the  re-  Maintenance  n^anuals  will  be  stored  on  the 
sponsible  Sikorsky  engineer,  and  then  entered  aircraft  computer.  14 
in  the  computer.  Electronic  copies  of  all 

changes  are  sent  also  to  all  departments  in-  Because  the  design  is  digital,  the  manufactur- 
volved  with  the  item  being  changed.  Figure  ing  engineering  department  at  Sikorsky  also 
60  shows  a  Sikorsky  engineer  reviewing  a  de-  is  able  to  begin  tooling  design  efforts  early  by 
sign  change  received  from  Westinghouse.  utilizing  the  latest  design  configuration  for  a 

particular  part  from  the  CATIA  system.  The 
On  the  Comanche  program  the  Army  has  a  CATIA  allows  the  engineers  to  check  for  inter- 
"one-deep"  maintenance  requirement  that  ferences  and  adjust  their  designs  accordingly, 
mandates  subsystems  and  components  can  be  Sikorsky,  in  conjunction  with  their  Pratt  & 
installed  only  one  deep  so  maintenance  per-  Whitney  sister  division,  also  has  the  capabil- 
sonnel  can  reach  one  item  without  having  to  ity  to  generate  a  solid  model  of  a  part  based 
remove  another  first.  Sikorsky  successfully  on  CATIA  dab  The  CATIA  information  is 
demonstrated  that  it  meets  this  requirement  sent  to  the  ste  olithography  machine  located 
by  simulating  the  removal  of  a  box  using  CA-  at  the  sister  '=»ciliiy  and  the  next  day  the  engi- 
TIA.  This  visualization  capability  with  the  neer  has  a  so;  a  part  for  design  confirmation, 
virtual  prototype  allows  maintenance  consid-  Stereolithography  has  been  used  also  to  de- 
erations  to  be  incorporated  in  the  preliminary  velop  a  scale  model  of  the  helicopter  that  was 
design  phase.  The  Comanche  will  be  main- 


Figure  60.  Sikorsky  Engineer  Reviewing  Design  Update 
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then  coated  with  metal  and  used  in  radar 
cross-section  evaluations. 

Another  key  computer-based  design  tool  be¬ 
ing  used  at  Sikoisky  is  Pro/Engineer.  Ac¬ 
cording  to  their  director  of  engineering 
automation,  this  system  represents  the  most 
advanced  CAD  tedmology  available.  It  al¬ 
lows  the  engineers  to  build  things  parametri¬ 
cally.  Design  iterations  and  changes  can  be 
incorporated  even  faster  than  they  could  in 
the  nonparametric  world.  The  engineer 
changes  a  value  and  the  computer  takes  over 
and  draws  the  new  revised  design.  Sikorsky 
is  planning  on  increasing  their  number  of 
Pro/Engineer  workstation  seats  and  their  CA- 
TIA  seats  to  180  positions  each.  ** 

Sikorsky  plans  to  use  the  same  digital  design 
capabilities  used  for  the  Comanche  program 
on  futiue  commercial  ventures.  The  five  or 
six  years  it  once  took  to  design  and  build  an 
aircraft  can  now  be  compressed  into  two  or 
three  years,  and  the  RAH-66  could  be  done 
faster  if  there  were  no  emnual  budget  con¬ 
straints.  Sikorsky  plans  to  build  a  commercial 
helicopter,  the  ^92,  and  they  believe  that 
within  two  years  after  the  design  effort  be¬ 
gins,  the  S-92  could  be  flying  and  it  could  be 
certified  wittiin  three  years.'' 

Based  on  our  observations  at  Sikorsky,  tech¬ 
nology  needed  to  create  virtual  prototypes  is 
available  and  the  potential  benefits  are  con¬ 
strained  only  by  d\e  imagination  of  those  in¬ 
volved  in  its  use. 

KOHLER 

Kohler  is  one  of  the  nation's  largest  privately 
held  companies  producing  enameled  cast- 
iron  and  china  plumbing  fixtures;  faucets  and 
fittings;  spas  and  leisure  products,  generator 
sets  and  switchgear;  and,  engines  designed 
for  worldwide  applications.  The  engine  divi¬ 
sion  produces  small  four-cycle  engines  as 


Figure  61.  Kohler  Engine 


shown  in  Figure  61.  They  range  in  size  from 
5-25  horsepower.  Located  at  Kohler,  Wis.,  the 
company  is  a  small  player  in  a  big  field.  Their 
strategy  is  to  sell  engines  offering  superior 
performance  and  high  reliability  at  a  pre¬ 
mium  price.  The  company  has  been  enor¬ 
mously  successful.  Their  record  speaks  for 
itself: 

1.  John  Deere  selected  Kohler  engines  over 
its  previous  supplier,  Kowasaki,  for  its 
large  lawn  tractors. 

2.  Market  share  has  grown  significantly  over 
the  past  several  years. 

3.  Manufacturing  cycle  times  have  been  cut 
by  two  years.'^ 

4.  Physical  prototypes  are  no  longer  neces¬ 
sary. 

5.  Kohler  offers  a  2-year  warranty  —  the 
longest  in  the  industry. 
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New  engine  designs  are  radically  different 
from  earlier  versions.  They  incorporate  a 
slant  cylinder  for  better  balance  and  lower  vi¬ 
bration  and  use  a  metric  configuration  for 
worldwide  application.  The  company  attrib¬ 
utes  their  success  to  the  application  of  com¬ 
puter  simulation  of  product  components  and 
systems,  largely  in  the  preliminary  design 
stages,  due  to  the  versatility  of  computer 
models.  Like  Boeing,  their  trursition  to  digi¬ 
tal  design  was  slow;  however,  once  in  place, 
they  reaped  a  significant  competitive  advan¬ 
tage. 

When  the  company  started  using  computer- 
aided  design  and  analysis  tools  eight  years 
ago,  they  spent  two  years  of  a  four-year  prod- 
uct-devdopment  cyde  designing  and  testing 
prototypes.  TWo  prototype  iterations  gener¬ 
ally  were  required  —  the  first  to  identify 
flaws  in  the  initial  design  and  the  second  to 
prove  the  flaws  had  been  corrected.  Once 
complete,  the  company  started  production. 
Now,  Kohler  starts  to  build  its  tooling  for  a 
new  engine  as  soon  as  the  computer  analysis 
validates  the  design.  They  have  found  the 
construction  of  prototypes  is  urmecessary  due 
to  the  accuracy  of  the  computer  models.  As  a 
result,  they  have  cut  an  average  of  two  years 
off  the  pr^uct  development  cycle.  Accord¬ 
ing  to  Kohler's  manager  of  advanced  engi¬ 
neering,  "The  name  of  the  game  is  getting 
products  out  the  door  faster.  Physical  proto¬ 
typing  is  like  doing  the  )ob  twice.  Even  eight 
years  ago  it  was  pretty  dear  that  computer 
simulation  of  engines  was  the  way  to  go." 

The  company  uses  solid  modeling  to  perform 
stress,  therrrral  and  vibration  analysis.  Their 
spiedfic  tools  indude  Unigraphics  solids  mod¬ 
els  that  are  transferable  for  finite  element 
analysis.  Their  finite  element  software  mod¬ 
els  are  created  using  Patran  from  PDA  Engi¬ 
neering,  and  I-Deas  from  Structural  Dynamics 
Research.  A  visualization  of  computer  analy¬ 
sis  of  engine  components  is  shown  at  Bgure 


Figure  62.  Computer  Visualization  of 
Engine  Parts 


62  and  Color  Plate  6.  One  of  the  challenges 
confronting  design  engineers  is  validating 
models.  At  Kohler  the  prindpal  problem  was 
ensuring  that  the  material  properties  in  the 
model  represented  the  physical  properties  of 
the  product.  It  took  them  several  years  to 
conduct  testing  to  verify  their  database.  Once 
established,  they  have  foimd  that  in  certain 
circumstemces  virtual  prototyping  produces 
more  accurate  results  dian  physical  testing.^* 
They  have  found  that  engineering  intuition  is 
not  always  right.  Their  software  tools  have 
produced  designs  that  ftiey  never  would  have 
investigated  if  physical  prototyping  was  re¬ 
quired. 

NASA/AMES  RESEARCH  CENTER 
Simulation  has  been  a  way  of  life  at  the 
NASA/ Ames  Research  Center  for  many  years 
and  because  of  this  rich  history,  it  was  high  on 
our  list  of  places  to  visit  Located  within  the 
NASA  compound  is  a  three-level  circular 
building  housing  a  joint  project  of  the  UB. 
Army  Aviation  and  Troop  Command  and  the 
NASA/ Ames  Research  Center.  The  Army  ef¬ 
forts  are  under  the  direction  of  the  Aeroflight- 
dynamics  Directorate.  The  Army  and  NASA 
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Crew  Station  Research  and  Development  Facility 
(CSRDF)  Components 


Experimenter/Operator 

Console 


Figure  63.  Major  CSRDF  Components 


selected  this  site  for  its  Crew  Station  Research 
and  Development  Facility  (CSRDF)  because 
Ames  is  NASA's  lead  center  for  rotary  air¬ 
craft,  human  factors  and  artificial  intelligence 
—  three  areas  considered  key  in  providing  a 
simulation  capability  to  support  preproduc¬ 
tion  research  for  the  next  generation  of  mili¬ 
tary  aircraft.  Mr.  Gossett,  Chief  of  the  Aircraft 
and  Simulation  Division,  was  instrumental  in 
establishing  the  CSRDF  and  his  1988  vision  of 
the  facility  is  appropriate,  "We're  trying  to 
make  this  a  great  facility  for  systems  integra¬ 
tion,  where  different  hardware  and  ideas  can 
be  put  into  place,  rapidly  reconfigured  and 
checked  out.  If  we  do  it  constructively,  then 
we  can  bring  everyone  involved  here  to  see 
how  it  works."  The  Army's  Science  Advisor, 
the  Military  Deputy  to  the  Army  Acquisition 
Executive,  and  more  than  100  senior  person¬ 


nel  recently  visited  the  facility  in  the  four-day 
period  preceding  our  trip,  attesting  to  the  suc¬ 
cess  of  the  CSRDF.  The  jointly  sponsored 
CSRDF  facility  contains  some  of  the  world's 
most  sophisticated  simulation  hardware.  Fig¬ 
ure  63  highlights  the  major  components  in  the 
CSRDF,  and  Color  Plates  7  and  8  depict  the 
actual  equipment 

The  first  tai^et  program  for  the  CSRDF  was 
the  Army's  Light  Helicopter  Experimental 
(LHX)  which  has  since  progressed  to  the 
Demonstration  and  Validation  phase  and  now 
is  known  at  the  RAH-66  Comanche  anned  re¬ 
connaissance  helicopter.  The  CSRDF  full  mis¬ 
sion  simulator  was  used  extensively  in  the 
preparation  of  specifications  for  the  LHX/Co- 
manche  program.  Every  functional  subsys¬ 
tem  in  the  aircraft  is  contained  in  the 
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CREW  STATION  RESEARCH  A 
OBJECTIVES 

Govi  dtvtlopimnt  of  engr  specs  for  advanced 
rotor  craft 

Examkialion  of  PWadvanced  MEP  issues  for 
edvanoedrotorcrefl 

High  fUelty  aviation  node  in  Defense  Simuia- 
tkxi 

Internet  to  support: 

Advencediech  Demos 

SATTtinists 

TRAOOC  War  Games 

DARPA  Programs 

iND  DEVELOPMENT  FACIUTY 

CAPABILITES 

Comanche  Baseline 

Fun  Mission  Equipment  Models 

200  Interactive  Combantants 

Fl>er  Optic  Helmet  Mounted  Display 

Rapidly  Reconfigured  Cockpit 

High  Fidelity  Visual  &  Math  Models 

Interactive  Tactical  Environment  Software 
Distributed  Simulation  Environment 

SIIULATIONS  COMPLETED  TO  DATE 

Comanche  Training 

Aided  Target  Recognition  PVI 

Helmet  Mounted  Display  Technology 

Integrated  ASE  PVI 

Stereo  HMD  Display  Requirements 

Obstacle  Avoidance  PVI 

PLANNED  ACTIViTIES 

CSRDF-AVTB  Networking  1-2QTRFY93 

MASAT-AIR  Evaluation  4QTRFY93 

ATCOM/TACOM  Joint  Exercises  FY94 

RPA  Developmental/initial  Evaluation  FY94^ 
Louisiana  Maneuvers  FY9S 

Joint  Precision  Strike  FY9S 

Warbreaker  FY97 

Final  RPA  Evaluation  FY97 

Figure  64.  CSRDF  Program  Overview 


simulator  as  well  as  every  other  system  the 
Army  crew  might  encouixter  in  an  actual  mis¬ 
sion,  both  friendly  and  hostile.  The  database 
includes  vehicles,  communications,  januners 
weapons,  as  well  as  the  tactics  that  might  be 
employed  on  a  given  mission.  According  to 
views  expressed  in  1988  by  the  Chief  of  the 
CSRDF,  fte  biggest  challenge  facing  die  Army 
on  this  program  was  to  determine  if  the  "pilot 
can  do  the  job  the  user  wants?"  Since  its  in¬ 
ception,  the  simulator  at  the  CSRDF  has 
played  a  central  role  in  resolving  such  issues. 
The  chart  shown  in  Figure  64  delineates  the 
current  objectives,  capabilities,  accomplish¬ 
ments  and  planned  activities  for  the  CSRDF. 

The  Rotonxaft  Pilot's  Associate  program 
(RPA)  and  the  Battlefield  Distributed  Simula¬ 
tion  -  Developmental  (BD5-D)  program  are 
two  major  efforts  the  CSRDF  is  supporting. 
Joint  exerdses  will  also  be  supported  via  the 


Internet.  Figure  65  shows  the  test  bed  coimeo 
tivity  for  these  programs  and  exercises. 

The  Army  Chief  of  Staff  tasked  the  Army  Ma¬ 
teriel  Command  and  the  Army  Acquisition 
Executive  to  "exploit  advanced  distributed 
simulation  to  improve  acquisition  from  con¬ 
cept  to  fielding."  Figiue  66  provides  an  over¬ 
view  of  the  future  envisioned  by  the  Army's 
leadership.  The  electronic  battlefield  is  at  Ae 
center  of  this  new  electronic  Army  and  the 
CSRDF  has  been  designated  to  be  a  key 
player  in  the  evolutionary  accomplishment  of 
this  task. 

ADVANCED  RESEARCH 
PROJECTS  AGENCY  (ARPA) 

The  ARPA,  formerly  DARPA  imtil  15  March 
1993  when  "Defense"  was  dropped  from  its 
name,  has  many  projects  focus^  on  improv¬ 
ing  the  ability  of  the  defense  industry  to  pro- 
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vide  the  latest  technologies,  efficient  pro¬ 
cesses  and  cost-effective  products  to  the  Ser¬ 
vices.  The  agency's  $1.5  billion  FY  1994 
budget  includes  funding  for  industry  research 
to  develop  and  demonstrate  advanced  infor¬ 
mation  technology  to  support  integrated 
product  and  process  development,  agile 
manufacturing  and  continue  the  War  Breciker 
simulation  program.  These  efforts  are  related 
directly  to  synthetic  environments,  virtual 
prototyping  and  the  acquisition  process. 

The  Manufacturing  Automation  and  Design 
Engineering  (MADE)  program  at  AREA  seeks 
to  focus  information  technology  on  applica¬ 
tions  in  concurrent  engineering,  flexible 
manufacturing  and  electronic  commerce. 
Structured  as  a  three  phase  program,  the 
MADE  objective  is  to  develop  an  integrated 
design,  arudysis  and  manufacturing  control 
prototype  software  enviroiunent  supporting 
full  life-cycle  acquisition  by  1996.  Phase  one 
of  MADE  was  initiated  in  1992  with  several 


contracts  to  construct  the  generic  software 
building  blocks  for  design  tools  and  design 
process  management.  Extensive  use  of  simu¬ 
lation  and  visualization  is  planned.  Phase 
two  includes  building  application  level  tools. 

Designing  for  assembly,  assembly  process 
simulation,  tolerance  synthesis,  design,  reuse 
and  modification  and  designing  for  rapid  tool 
setup  and  changeover  will  be  demonstrated 
in  ftre  flexible  manufacturing  of  inff-ared  focal 
plane  arrays  and  sensor  packages.  Flexible 
factory  concepts  will  use  low-cost  modular 
equipment,  a  wafer  cassette  process  that 
eliminates  the  need  for  a  clean  room  and  in¬ 
telligent  manufacturing  process  control  sys¬ 
tems.  Advanced  Technology  Demonstrations 
(ATD),  supporting  S&T  Thrust  Seven,  are  pro¬ 
posed  for  phase  two.  Phase  three  will  consist 
of  a  series  of  demonstrations  to  prove  the  suc¬ 
cess  of  an  industry-wide  distributed  flexible 
manufacturing  infrastructure. 
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Figure  67.  MADE  Program  Will  Develop  Interfaces  Between  Processes  (Source:  ARP  A) 


The  MADE  program  is  expected  to  pay  off 
with  a  major  reduction  in  acquisition  cyde 
time,  facilitate  a  suige  in  production  in  time 
of  war  and  allow  rapid  fielding  of  the  latest 
technology.  Figure  67  shows  the  steps  in  the 
design  process  from  requirements  definition 
to  manufacturing.  Spedalized  software  tools, 
usually  operating  in  isolation,  are  employed 
at  each  step  in  the  process  and  design  infor¬ 
mation  is  passed  along  the  process  across  in¬ 
terfaces  (represented  by  II  to  16). 

Unfortunately,  many  of  these  interfaces  are 
not  fully  automated  and  require  significant 
manual  reformatting  to  provide  usable  inputs 
for  the  next  stage.  The  ARPA  is  woiking  on 
standard  languages  to  improve  infoimation 
exchange.  Emulation  is  used  at  each  step  to 
accomplish  design  goals.  Finally,  the  results 
of  the  design  process  are  held  in  a  global 
product  database  available  to  all  partidpants. 


There  are  numerous  benefits  to  using  infor¬ 
mation  technology  as  the  MADE  program  en¬ 
visions: 

—  Easy  flow  of  information  between  stejjs  in 
the  process  supports  an  iterative  approach 
to  designing.  Cyde  time  is  decreased;  tiius, 
designs  can  be  refined  to  a  higher  degree  of 
accuracy  in  the  final  product  and  rework  is 
reducecl  significantly. 

—  Geographically  dispersed  organizations 
can  partidpate  in  the  design  process  over 
wide  area  networks. 

— Well-defined  interfaces  between  steps  in 
the  process  allow  easy  removal  and  re¬ 
placement  of  each  software  process  as  new 
programs  are  developed  This  can  be  ac¬ 
complished  with  no  disruption  to  the  over¬ 
all  design  process. 
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— Wth  standard  interfaces  defined,  n\any 
companies  will  have  the  ability  to  enter  the 
design  process.  Competition  is  enhanced 
in  indnstiy  when  many  companies  can  par¬ 
ticipate  in  the  design  effort  electronically. 

A  second  significant'  program  at  AREA  from 
the  perspective  of  this  report  is  the  War 
Breaker  simulation.  War  Breaker  develops 
and  demonstrates  the  capabilities  of  an  inte¬ 
grated  system  that  detects,  identifies,  targets 
and  neutralizes  time-critical  targets.  Focusing 
on  key  AREA  technology  developments  and 
service  initiatives.  War  Breaker  is  coupled 
closely  with  the  Erecision  Strike,  Global  Sur¬ 
veillance,  and  Communications  Science  and 
Technology  Thrusts.  Using  distributed  inter¬ 
active  simulation.  War  Breaker  has  the  capa¬ 
bility  to  visualize  and  communicate  system 
performance  and  requirements  using  man-in- 
the-loop  interactive  simulation.  War  Breaker 
supports  bench  testing  of  sensors  and  soft¬ 
ware,  and  modeling  and  flight  testing  of  full 
weapons  systems.  Additionally,  the  War 
Breaker  simulation  environment  will  be  used 
as  a  system  engineering  tool  to  identify,  de¬ 
fine,  verify  and  validate  system  requirements. 
AREA  states  ttiat: 

Emerging  simulation  technologies  could  be 
applied  to  system  engineering  and  acquisi¬ 
tion  issues,  itKluding  evcduation  of  a  pro¬ 
posed  system’s  measure  of  effectiveness  at 
the  theater  level;  feasibility  assessment  of 
hardioare  and  software  at  the  component 
level;  and  development  and  testing  ofvxap- 
ons  systems. 

War  Breaker  is  an  excellent  example  of  using 
synthetic  environments  and  virtual  proto¬ 
types  to  determine  system  requirements. 
Critical  design  issues  can  be  investigated  in 
detail.  This  is  especially  important  for  prob¬ 
lems  which  require  a  high  degree  of  human 
interaction  from  among  diverse  oiganizations 
peutidpating  with  multiple  weapon  systems. 


A  third  significant  program  at  AREA  is  aimed 
at  revamping  the  Navy's  ship  and  submarine 
design  process.  Recently,  ARPA  awarded  con¬ 
tracts  for  the  initial  18-month  phase  of  a  pro¬ 
gram  to  "link  geographically  disparate  design 
teams  by  high-speed  networks  so  they  can  ex¬ 
change  their  ideas  in  real  time  and  use  virtual 
reality  technology  to  model  and  test  their 
work  before  a  prototype  is  ever  built."  Ex¬ 
pectations  are  that  the  time  to  design  a  ship 
can  be  cut  in  half  —  without  using  a  physical 
mock-up  and  with  increased  quality. 

U,S.  ARMY  NIGHT  VISION  AND 
ELECTRONIC  SENSORS  DIRECTORATE 
Efforts  are  underway  at  the  US.  Army's 
Night  Vision  and  Electronic  Sensore  Director¬ 
ate  (NVESD)  to  develop  what  may  be  the 
world's  first  synthetic  infrared  target  environ¬ 
ment  that  is  realistic  and  scientifically  accu¬ 
rate.  This  itdrared  model  capability  is  being 
pursued  to  support  programs  such  as  Co¬ 
manche  and  Apache  Longbow  that  need  a 
high-fidelity  simulation  which  can  be  used  to 
evaluate  the  Automatic  Target  Recogrution 
(ATR)  algorithms  associated  with  sophisti¬ 
cated  multi-sensor  configurations.  The 
NVESD  infrared  simulations  are  produced  by 
the  Visionics  and  Image  Signal  Erocessing  Di¬ 
vision  and  their  software  product,  NVSIM, 
will  be  available  to  the  Forward  Looking  In- 
fraRed  (FLIR)  community. 

Commonly  referred  to  as  the  Night  Vision 
Laboratory,  NVESD  has  extensive  experience 
developing  infrared  scale  models  and  terrain 
boards  used  in  various  iirfrared  simulations. 
The  physical  terrain  board,  shown  in  Figure 
68,  is  used  with  many  different  infrared  scale 
models  to  create  scenarios  which  support  a 
variety  of  applications.  Figure  69  is  an  infra¬ 
red  picture  of  a  scale  model  tank  taken  on  the 
physical  terrain  board.  The  NVESD  has  an 
extensive  library  of  infrared  pictures  and  in¬ 
frared  video  that  depict  military  equipment 
and  typical  background  topographies.  The 
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Figure  68.  N VESD  Physical  Terrain  Board 


Figure  69.  Infrared  Picture  of  Thermal  Tank  Model 
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pictures  and  video  tapes  are  used  in  simula¬ 
tions  that  are  programmed  against  a  specific 
scenario;  for  exait^le,  if  a  tank  drives  in  one 
specific  direction  at  a  spedried  time  of  day, 
the  imagery  displayed  can  be  preselected  to 
provide  a  realistic  view  of  the  tank's  target 
and  the  terrain  over  which  the  tank  operates. 
The  ability  to  combine  the  infrared  library 
with  infrared  target  imagery  on  the  terrain 
board  has  enabled  NVESD  to  accommodate 
numerous  user,  developer  and  tester  needs. 

But,  there  are  significant  limitations  that  are 
well  documented,  such  as  the  lack  of  atmos¬ 
pheric  effects  and  the  inability  to  simulate 
anything  ottier  than  forward  looking  infrared 
(FUR)  and  television  sensor  s}rstems.  To  over¬ 
come  these  shortcomings  and  to  meet  the  new 
requirements  associated  witti  multisensor 
platforms,  NVESD  is  developing  a  state-of- 
the-art  digital  model  of  an  inured  battlefield 
environment.  ® 

This  new  capability  will  have  the  potential  to 
support  the  emerging  soldier-in-the-loop 
weapon  system  simulations  that  will  soon  be 
used  to  rnake  critical  major  weapon  system 
acquisition  decisions.  These  new  simulations 
are  totally  dynamic  and  the  weapon  system 
driver  and/or  the  gurmer  have  the  real-time 
ability  in  the  simulator  to  view,  drive  and 
fight  in  all  directions  at  any  time  of  the  day  or 
night  If  realistic  evaluations  are  to  be  per¬ 
formed  on  the  ability  of  the  operator  to  detect 
targets  with  virtual  prototypes  that  contain 
new  sensors,  a  high-fidelity  virtual  prototype 
of  the  itrfrared  envinorunent  that  ^e  sensor 
can  see  must  be  developed.  The  NVESD  is 
addressing  this  challenge  in  an  incremental 
approach  that  allows  it  to  take  advantage  of 
the  advancements  in  computer  technology 
continuously. 

To  develop  a  digital  infrared  enviroruitent, 
massive  computer  power  is  recpiired  to  por¬ 
tray  realistic^y  the  infrared  signatures  of 


every  feature  in  the  field  of  view.  This  is  es¬ 
pecially  true  for  scenarios  that  portray  differ¬ 
ent  ty]^  of  weather  at  various  times  of  the 
day  or  rright.  Since  this  is  an  infrared  domain, 
every  object  in  the  camera's  field  of  view  (the 
digil^  enviroiurrent)  has  a  uruc^e  signature 
which  changes  based  on  the  angle  from  which 
it  is  being  viewed  The  signature  is  composed 
of  thermophysical  properties  such  as  reflec¬ 
tivity,  emissivity,  thermal  conductivity,  den¬ 
sity  and  specific  heat  “  The  camera's  picture 
presented  to  the  operator  must  also  be  ad¬ 
justed  by  the  computer  to  account  for  factors 
such  as  the  field  of  view  and  the  impact  of 
platform  vibration  on  the  seirsor. 

This  is  no  trivial  task  and  only  until  recently 
could  modeling  be  attempted  for  anything 
more  than  selected  targets  or  selected  samples 
of  vegetation,  and  even  this  limited  sample 
could  not  be  done  in  real  time.  With  recent 
dramatic  increases  in  computer  processing 
power,  the  prerequisite  computer  capability 
to  expand  these  single  targets  and  back¬ 
grounds  into  an  infrared  envirorunent  finally 
has  become  available.  If  the  ever-increasing 
performance  trend  in  computers  continues,  it 
may  be  possible  to  develop,  before  the  end  of 
the  decade,  a  fully  dynamic  infrared  ’nviron- 
ment  for  use  in  real  time  soldier-in-the-loop 
simulations. 

During  our  visit  we  observed  the  significant 
progress  the  Visionics  and  Image  Processing 
Division  persormel  have  made  in  developing 
digital  infrared  models  of  military  equipment, 
trees,  and  other  types  of  vegetation.  It  is  im¬ 
portant  to  note  that  NVSIM  is  being  devel¬ 
oped  around  modular  programming  tech¬ 
niques  to  facilitate  the  incorporation  of  addi¬ 
tional  sensor  effects  as  they  become  available. 
Selected  sensor  effects  can  also  be  included  or 
excluded  at  run  time.  The  NVSIM  is  written 
in  standard  ANSI  C  programming  language 
and  uses  a  UNIX  operating  system  to  make  it 
portable  to  most  modem  workstations.  Fig- 
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Figure  70.  High  Fidelity  Digital  Tenain  Board  (Source:  NVESD) 


ure  70  illustrates  their  current  ability  to  gener¬ 
ate  impressive  high  hdelity  scenes  for  the 
digital  terrain  board.  Although  the  ultimate 
real-time  digital  infrared  environment  is  far 
off,  significant  steps  are  being  made  and 
could  be  accelerated  if  additional  resources 
were  committed  to  this  promising  effort. 

ACADEMIC  RESEARCH 
University  of  North  Carolina  at  Chapel  Hill 
The  facility  which  houses  the  computer  center 
at  the  University  of  North  Carolina  (UNO  at 
Chapel  Hill  existed  in  cyberspace  before  it 
was  actually  constructed.  The  virtual  veision 
of  Sitterson  Hall  allowed  f>eople  who  were 
going  to  work  in  the  building  to  "walk 
through"  the  model  in  cyberspace.  Many  of 
them  felt  that  one  particular  feahare  in  the 
lobby  created  a  cramped  feeling  in  a  busy 
hallway.  The  architects  didn't  agree  until  the 
future  occupants  used  the  3-D  cyberspace 


model  to  give  the  planners  a  chance  to  "walk 
through"  themselves.  As  a  result,  the  parti¬ 
tion  was  moved,  the  building  constructed, 
and  there  is  no  feeling  of  being  cramped  in 
the  physical  lobby  today.  The  UNC  facility  is 
quite  impressive.  While  at  UNC,  we  saw 
graphics  displays  generated  by  their  Pixel- 
Planes  5  multicomputer,  used  their  head 
mounted  display  and  stereoscopic  displays  to 
"walk  through"  a  virtiul  kitchen  and  used 
their  Aigon  Remote  Manipulator  (ARM)  in  an 
attempt  to  dock  molecules.  The  following 
paragraphs  discuss  each  of  these  three  capa¬ 
bilities. 

The  Pixel-Planes  5  multicomputer  system  ren¬ 
dered  the  highest  quality  graphics  of  all  the 
locations  visited.  The  topography  looked  ex¬ 
actly  like  a  photograph  taken  with  a  high- 
powered  lens.  It  was  as  close  to  real  life  as 
one  can  expect.  The  system  consists  of  a 
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Graphics  Processor,  a  Renderer  and  a  Ring 
Network. 

The  Graphics  Processor  is  general-purpose 
and  math-oriented  and  carries  out  geometric 
transformations  and  other  scaleabie  calcula¬ 
tions.  It  is  a  powerful,  math-oriented  com¬ 
puting  node  based  on  the  Intel  i860 
nucroprocessor.  Renderers,  fine-grain,  mas¬ 
sively  parallel  arrays  of  processors  based  on 
custom  logic  enhanced  memory  chips,  per¬ 
form  moot  oixel-oriented  calculations  in  par¬ 
allel.  It  employs  a  novel  approach  to  graphics 
image  genervii jn  n  which  the  transformation 
engine  specifies  the  objects  on  the  screen  in 
pixel-independent  terms,  and  ;he  Renderer 
works  from  the  description  lo  generate  the  fi¬ 
nal  image. 


The  Ring  Network  moves  data  and  control 
messages  between  system  components  at 
high  speed.  It  links  the  parts  of  the  system, 
moves  object  descriptions  and  pixel  data  be¬ 
tween  components,  and  provides  the  consid¬ 
erable  bandwidth  needed  to  take  full 
advantage  of  the  performance  of  the  parallel 
Graphics  Processors  and  Renderers.  The  Ring 
operates  at  an  aggregate  data  rate  of  160  mil¬ 
lion  32-bit  words  per  second,  supporting 
eight  simultaneous  data  streams  between 
Ring  ports  at  20M  words  per  second  (32-bit 
words).  The  machine  rapicUy  renders  polygo¬ 
nal  images  with  advanced  lighting  models 
and  textures,  directly  renders  spheres  as  well 
as  objects  described  by  constructive  solid  ge- 
omet^,  perfonns  near  real-time  rendering  of 
volume  data  sets  modeled  as  transparent  gels, 
and  executes  a  variety  of  image-processing  al¬ 
gorithms.  It  is  modular  and  can  be  config¬ 
ured  in  a  variety  of  ways  to  trade  cost  for 
performance.  Pixel-Planes  5  is  an  example  of 
a  multicomputer,  a  class  of  parallel  machines 
that  has  multiple  computing  nodes,  each  with 
its  own  memory  system 


We  walked  through  a  virtual  kitchen  and 
opened  cabinet  doors  utilizing  a  HMD  and 
the  head-tracked  stereoscopic  displays.  To 
achieve  this  effect,  the  computer  must  con¬ 
stantly  receive  information  about  the  precise 
position  and  orientation  of  the  user's  head 
and  must  respond  immediately  to  all  changes 
in  head  position  by  adjusting  the  displayed 
images  appropriately.  The  head-tracker  pro¬ 
ject  at  UNC  investigates  and  develops  meth¬ 
ods  for  this  position  tracking.  Their 
immediate  goal  is  to  develop  optical  head¬ 
tracking  technology  that  will  fimction  within 
a  room-sized  environment  and  be  accurate 
within  1-2  mm  and  0.1  degrees. 

We  used  the  system  that  utilizes  an  optoelec¬ 
tronic  tracker.  The  system  features  light-emit¬ 
ting  diodes  (LEDs)  mounted  in  the  ceiling  of 
a  room  and  imaging  sensore,  based  on  lateral- 
effect  photodiodes,  mounted  on  the  head  of 
the  HMD  (see  Figure  71).  Color  Plate  9 
shows  a  user  with  the  HMD  in  the  virtual 
kitchen  and  the  view  the  user  sees.  In  opera¬ 
tion,  as  a  HMD  wearer  walks  beneath  the  ceil¬ 
ing,  a  real-time  multiprocessor  system 
computes  the  position  and  orientation  of  the 
user's  head.  Chie  68030-based  processor  finds 
the  set  of  LEDs  in  each  sensor's  field  of  view, 
illuminates  the  appropriate  LEDs  according 
to  an  LED  driver  and  extracts  photo  coordi¬ 
nate  data  from  the  image  sensors.  This  proc¬ 
ess  is  complicated  by  the  fact  that  as  the  HMD 
wearer  moves,  the  sets  of  LEDs  change  con¬ 
stantly.  To  their  knowledge,  this  is  the  first 
demonstrated  scaleabie  tracking  system  for 
HMDs,  meaning  that  to  cover  any  room  size, 
one  need  only  add  more  panels  to  the  ceil- 
ing.“ 

We  also  wore  3'D  glasses  and  the  ARM  in  an 
attempt  to  dock  chemical  molecules.  These 
tools  are  a  way  of  using  highly  refined  capa¬ 
bilities  of  the  h.  .man  haptic  system  to  explore 
chemical  bonds.  Users,  navigating  in  three 
dimensional  space,  move  strings  of  molecules 
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Figure  71.  Room*Sized  LED  Tracking  System 


in  various  directions  to  mesh  witi\  other 
molecules.  As  assessed  by  one  of  the  Fellows: 
"At  first,  I  felt  as  if  I  was  wrestiing  with  the 
ARM  as  I  tried  to  twist,  jam,  rotate  and  extract 
molecules,  unsuccessfully  may  I  add.  Once  I 
felt  comfortable  with  the  system,  however,  it 
worked  easily  and  I  was  able  to  move  objects 
around  freely  with  little  difficulty."  Color 
Plate  10  shows  an  operator  immersed  in 
molecule  docking.  Harold  Rheingold  de¬ 
scribed  the  experience  as; 

Knowing  next  to  nothing  about  the  chemis¬ 
try  symbolized  by  the  colored  clouds  floating 
in  virtual  space  and  the  tinkertoy  bonds  that 
I  could  feel  in  my  arm  bones,  I  was  able  to 
find  my  way  into  a  place  where  the  ARM  re¬ 
sisted  at  a  minimum  amount  between  all  its 
degrees  of  freedom.  It  was  more  like  playing 
a  video  game  or  a  trombotw  than  any  prcAh 


lem-solving  I  remembered  from  high  school 
chemistry.  ^ 

The  Human  Interface  Laboratory  (HITL) 

The  state  of  Washington  created  the  Washing¬ 
ton  Technology  Center  (WTC)  in  1983  as  a 
catalyst  for  statewide  economic  development. 
Its  goal  is  to  attract  private  industry  and  fed¬ 
eral  research  dollars  to  help  finance  commer¬ 
cially  promising  research  at  the  state's 
universities.  In  October  1989,  the  WTC  estab¬ 
lished  the  Human  Interface  Technology  Labo¬ 
ratory  with  the  stated  objective  of  trans¬ 
forming  virtual  world  concepts  and  research 
into  practical,  economically  viable  technology 
and  products.  They  founded  the  \^rtual 
Worlds  Consortium,  consisting  of  more  than 
15  organizations,  including  large  corporations 
like  Boeing,  Ford,  American  Express,  tire  Digi¬ 
tal  Equipment,  along  witii  other  organizatiorrs 
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like  the  US.  Navy  and  the  Port  of  Seatde.  The 
consortium  supports  the  HITL  as  a  forum  for 
the  advancement  of  virtual  worlds  tedmol- 
ogy;  for  educating  professionals,  students, 
and  the  general  public  regarding  virtual 
worlds  technology;  and  for  enhancing  com¬ 
mercial  applications  of  virtual  worids  tedi- 
nology.  Membership  costs  participants 
$50,000  per  year  and  the  annual  fees  are 
pooled  to  support  selected  research.  ^ 

The  Laboratory's  core  activities  include  the 
virtual  knowledge  interface  base  (VKIB)  and 
the  virtual  simulation  laboratory  (VSL), 
which  support  a  number  of  specific  projects 
including  the  Virtual  Retinal  Display  (VRD). 
The  objective  of  the  VKIB  project  is  to  provide 
a  repository  for  technical  discussion,  experi¬ 
mental  data,  research  findings,  and  other  in¬ 
formation  related  to  virtual  interface 
technology.  Current  VKIB  activities  include 
establishing  a  comprehensive  literature  and 
media  collection,  hosting  the  Usenet  news- 
group,  preparing  hard  copy  newsletters  on  re¬ 
search  developments  in  virtual  reality,  and 
beginning  a  scientific  and  engineering  journal 
to  disseminate  research  findings. 

The  VSL  is  a  unique  simulation  laboratory  in¬ 
corporating  virtual  interface  controls  and  dis¬ 
plays  to  support  the  development  of 
advanced  interface  concepts.  It  will  be  used 
to  investigate  the  underlying  human  sensory, 
perceptual  and  psychomotor  behavior  associ¬ 
ated  with  interaction  in  virtual  interface;  de¬ 
velop  interface  devices;  explore  new  virtual 
interface  concepts;  and,  develop  metrics  to  as¬ 
sess  the  goodness  of  the  control  and  display 
approaches. 

The  VRD  project  has  great  potential.  Its  ob¬ 
jective  is  to  project  high  resolution  color  im¬ 
ages  directly  on  the  retina.  The  lab  plans  to 
commercialize  this  product  and  sell  it  in  the 
mid-1990s  for  imder  $5/XX).  The  advantages 


of  tire  VRD  are  sigrrificanfc  wide  field-of- 
view,  high  resolution,  small  size  /  weight,  low 
cost  and  color.  Other  projects  at  the  HITL  in¬ 
clude  3-D  audio  graphics,  position  tracking. 
Virtual  Environment  Gyrating  System 
(VEOS),  virtual  prototyping,  visualization, 
televirtuality,  education  and  prostheses  re¬ 
search. 

One  of  the  HITL's  first  projects  had  the  poten¬ 
tial  for  commercial  application  at  the  Port  of 
Seattle.  According  to  the  director  of  informa¬ 
tion  systems  at  the  Port,  there  were  two  rea¬ 
sons  the  Port  was  pursuing  VR  modeling. 
Rest,  they  saw  it  as  a  kind  of  "what-if"  nw- 
chine  for  port  design,  running  the  simulation 
through  Afferent  situations  to  see  how  the 
whole  system  reacts. 

The  second  reason  was  more  compelling;  the 
Port  planned  to  use  the  model  as  a  communi¬ 
cation  device  with  the  Port's  biggest  clients  — 
Japanese,  Chinese,  Korean  and  others.  They 
are  hopeful  that  misunderstandings,  delays 
and  costs  caused  by  spoken  language  barri¬ 
ers  might  be  nutigated  if  engineers,  planners 
and  clients  on  both  sides  of  the  Pacific  could 
walk  through  VR  versions  of  the  proposed 
construction  during  every  stage  of  the  plan¬ 
ning  process. 

The  technological  applications  included  being 
able  to  walk  through  a  virtual  facility,  operate 
cranes  from  inside  ships,  and  locate  equip 
ment  —  actually  operate  a  facility  in  the  vir¬ 
tual  world  as  if  it  was  a  real  terminal.  Since 
no  other  port  facility  in  the  world  offered 
such  a  capability,  it  would  undoubtedly  give 
the  Port  a  competitive  advantage  in  attracting 
customers.  Urifortunately  the  VR  project,  en¬ 
visioned  only  two  years  ago,  has  been  aban¬ 
doned.  The  primary  reason  given  was  that 
the  VR  effort  was  launched  too  late  and  the 
PorP  s  engineers  were  already  too  far  alo^  in 
their  design  efforts  to  use  the  VR  system 
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Other  Institutions  their  Institute  of  Simulation  and  Training, 

Other  institutions  that  shared  their  time  and  Florida  Institute  of  Technology,  and  the  Air 
resources  with  us  were  the  University  of  Day-  Force  Institute  of  Technology.  Their  contribu- 
ton,  the  University  of  Central  Florida  and  tions  are  included  tiuoughout  this  report 
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Nothing  will  ever  be  attempted  if  all  possible 
objections  must  first  be  overcome. 

—  Samuel  Johnson 

Chapter  6 

CONCLUSIONS  AND 
RECOMMENDATIONS 


When  we  started  this  research  effort, 
we  were  skeptical  about  the  useful¬ 
ness  of  virtual  prototyping  in  the 
acquisition  process  so  we  set  aside  the  theory 
and  sought  out  defense  and  conunerdal  com¬ 
panies,  along  with  universities,  that  had  used 
virtual  prototyping.  Our  journey  took  us  to 
laige  and  sm^  companies,  some  with  and^i- 
tious  virtual  prototyping  programs  and  oth¬ 
ers  doing  little.  It  was  enlightening  to 
discover  that  virtual  prototyping  does,  in  fact, 
produce  significant  and  measurable  results. 
We  believe  it  produces  a  more  robust  design 
and  significantly  reduces  costs  and  product 
development  cyde  times.  We  saw  an  example 
of  a  conunerdal  company  that  had  gained  a 
significant  competitive  advantage  in  their 
market.  Virtual  prototypes  are  useful  in  the 
design  of  complex  systems  like  Boeing's  777 
and  in  far  less  sophisticated  items  such  as 
four-<yde  18  horsepower  lawn  mower  en¬ 
gines,  and  for  almost  everytiiing  in  between. 
We  believe  they  can  be  beneficial  in  any  appli¬ 
cation  involving  significant  design  effort  or 
complex  numufacturing  that  has  previously 
used  physical  prototypes. 

Fundamental  changes  in  the  defense  acquisi¬ 
tion  process  have  increased  dramatically  the 
importance  of  virtual  prototyping  in  the  ac¬ 
quisition  of  new  weapon  systems.  Based  on 
our  review  of  applicable  literature,  interviews 
wifii  more  thw  50  individuals  assodated 
with  the  technology,  and  visits  to  more  than 


25  companies,  we  offer  the  following  condu- 

sions  and  recommendations. 

CONCLUSIONS 

1.  In  many  cases,  physical  prototypes  are  no 
longer  necessary,  ^firtual  prototypes, 
based  on  CAD/CAM  data,  are  taking  the 
place  of  physical  prototypes.  Today's 
CAD/CAM  tools  reduce  design  and 
manufacturing  costs,  shorten  cyde  times, 
and  yield  better  designs.  Industry  is  plac¬ 
ing  less  reliance  on  physical  prototypes. 
They  have  embraced  CAD/CAM  because 
of  its  payback  derived  from  lower  manu¬ 
facturing  costs  due  to  fewer  design 
changes  —  the  parts  fit  together  the  first 
time  and  designs  are  produdble.  E>esign 
and  manufacturing  engineers  can  now  as¬ 
sess  the  feasibility  of  manufacturing  a 
part  and  then  modify  the  design  or  manu¬ 
facturing  processes  before  actually  pro¬ 
ducing  ^e  product 

2.  Rapid  prototyping  greatly  accelerates  the 
production  of  new  products.  Rapid  pro¬ 
totyping  techniques  are  being  used  in¬ 
creasingly  by  large  US.  manufacturers. 
Successful  implementation  of  rapid  pro¬ 
totyping  requires  organizational  commit¬ 
ment  and  the  application  of  several  key 
technologies.  Prototypes  are  a  direct  link 
to  the  production  process  and  can  be  used 
to  enhance  communication  wifi\  custom¬ 
ers  and  vendors.  They  can  be  shown  to 
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customers  to  demonstrate  the  physical 
properties  of  the  product  and  agree  on 
any  desired  design  modifications  before 
beginning  tooling  or  production.  Proto¬ 
types  also  can  be  sent  to  vendors  of  conv- 
plex  parts  or  subassemblies  to  assist  them 
in  developing  an  accurate  quote. 

3.  Virtual  prototyping  can  provide  a  clear, 
competitive  edge  to  companies  who  em¬ 
brace  and  successfully  implement  its  fea¬ 
tures.  Reduced  cycle  times  provide  the 
opportunity  to  m^e  new  products  avail¬ 
able  in  less  time  and  thus  permit  a  com¬ 
pany  to  become  a  market  leader.  In 
addition,  companies  usually  can  realize  a 
positive  return  on  their  virtual  prototyp¬ 
ing  investment  in  less  than  two  years.  It 
is  an  area  where  dual-use  investment  has 
tremendous  potential. 

4.  Virtual  reality  has  great  potential,  but  it  is 
not  clear  when  DOD  will  be  able  to  bene¬ 
fit  from  the  use  of  this  technology.  Visual 
images  in  today's  head-mounted  displays 
are  cartoon-like.  Headsets  are  bulky  and 
have  an  awkward  umbilical  connected  to 
the  computer  that  restricts  movement. 
Also,  some  operators  tend  to  feel  side 
while  using  the  head-mounted  displays. 
Virtual  reality  does  have  tremendous  po¬ 
tential  in  the  entertainment  industry,  and 
significant  investment  in  this  technology 
is  being  made  to  e^qploit  this  new  capabil¬ 
ity.  Virtual  reality  applications  in  DOD 
will  be  paced  by  the  speed  with  which 
breakthroughs  are  made  in  display  reso¬ 
lution,  computer  update  speed,  and  op¬ 
erator  mobility. 

5.  Verification,  validation  and  accreditation 
(W&A)  of  the  software  used  to  create 
synthetic  battlefields  and  virtual  weapons 
systems  is  a  major  challenge.  Who  within 
DOD  has  the  responsibility  for  accredit¬ 
ing  these  s)mfiietic  battlefidds  and  weap¬ 


ons  systems  and  how  will  this  be  accom¬ 
plished?  Standards  are  needed  and  soft¬ 
ware  tools  need  to  be  built  to  facilitate 
W&A.  Who  within  DOD  has  the  respon¬ 
sibility  for  this  challenge,  and  where  will 
the  necessary  funds  be  found  to  support 
this  effort?  The  responsibility  does  not 
appear  to  be  clearly  delineated  within  the 
DOD. 

6.  The  computing  power  available  today 
falls  short  of  that  needed  to  produce  high 
quality  images  for  synthetic  environ¬ 
ments.  Implementing  a  desirable  level  of 
realism  will  recpiire  a  significant  invest¬ 
ment  in  software  development.  Software 
development  tools  needed  for  rapid  con¬ 
struction  of  battlefield  simulations  are  al¬ 
most  nonexistent.  Synthetic  battiefields 
need  to  look  real  and  they  need  to  present 
the  same  environmental  conditions  to  all 
participants.  These  envirorunenis  need  to 
include  semiautomated  forces  which  ac¬ 
curately  mimic  human  behavior.  Finally, 
models  used  to  represent  realistic  human 
performance  and  decision  making  need 
to  be  validated. 

7.  Virtual  prototypes  can  be  a  valuable  tool 
for  program  managers  to  use  in  identify¬ 
ing  and  managing  program  risks.  Pro¬ 
gram  managers  are  required  to  develop 
acquisition  strategies  and  program  plans 
that  are  event-driven  and  that  explicitly 
link  major  contractual  commitments  and 
milestone  decisions  to  demonstrated  ac¬ 
complishments  in  development,  testing 
and  initial  production.  At  each  milestone 
decision  point,  assessments  are  required 
of  the  status  of  program  execution,  plans 
for  the  next  phase,  and  fite  rest  of  the  pro¬ 
gram.  Virtual  prototypes  can  be  used  ef¬ 
fectively  to  measiwe  performance  against 
milestone  dedsion  criteria.  They  can  be 
used  to  test  the  system  or  certain  high- 
risk  subsystems  against  certain  simulated 
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threats,  assess  the  effectiveness  of  the  pro¬ 
posed  technology  and  evaluate  the  feasi¬ 
bility  of  the  design  for  produdbility. 
Virtual  prototypes  can  be  us^  also  to  as¬ 
sess  the  risks  inherent  in  die  degree  of 
concurrency  being  proposed  for  a  pro¬ 
gram. 

8.  Major  weapon  system  acquisition  deci¬ 
sions  in  die  future  will  be  significantly  in¬ 
fluenced  by  the  performance  of  virtual 
prototypes  in  syndietic  batdefields.  The 
DOD  war  planners  and  higher  level  deci¬ 
sion  makers  will  use  synthetic  environ¬ 
ments  that  employ  different  weapon 
systems  and  different  force  structures  to 
evaluate  their  warfighting  impact.  Inher¬ 
ent  in  these  ongoing  synthetic  force-on- 
force  evaluations  will  be  the  opportunity 
to  insert  a  new  capability  via  a  virtual 
prototype  and  evaluate  ife  impact  The 
ultimate  test  for  each  system  will  be  to 
demonstrate  value-added  war  fighting 
capability  that  is  significant  enough  to  in¬ 
fluence  the  outcome  of  a  conflict  that 
takes  place  in  a  specified  batUespace.  If  a 
significant  warfi^ting  capability  is  dem¬ 
onstrated,  a  decision  will  be  made  to 
either  upgrade  existing  systems  through 
incorporation  of  the  technology  or  to  be¬ 
gin  the  development  of  an  entirely  new 
system  based  on  die  virtual  prototype's 
performance  during  the  test. 

9.  A  virtual  prototype  can  influence  product 
support  positively,  or  system  advocacy  in 
DOD  terminology,  at  all  levels  of  the  ac¬ 
quisition  process.  Being  able  to  demon¬ 
strate  the  "value-added"  capabilities  of  a 
new  system  while  at  the  same  time  con¬ 
vincing  the  audience  that  die  technical 
and  financial  risks  associated  widi  obtain¬ 
ing  this  capability  are  reasonable  will  be 
essential  in  future  multilayered  funding 
competitions  that  will  exist  in  the  late 
1990s.  Three-dimensional  visualization 


that  can  be  provided  by  a  virtual  proto¬ 
type  also  facilitates  the  introduction  of  a 
new  weapon  system  concept  and  is  a 
means  to  increase  user  involvement  in  the 
development  process  by  providing  a  bet¬ 
ter  foundation  for  user  and  developer 
communications. 

10.  Virtual  prototypes  enhance  a  company's 
competitiveness  by  giving  it  a  perceptual 
edge.  Virtual  prototypes  can  assist  both 
the  contractor  and  the  government  pro¬ 
gram  manager  in  understanding  new 
doctrineil  concepts  and  warfighting  im¬ 
pact  of  new  systems.  More  importantly,  it 
provides  a  means  for  the  engineeis  to 
visualize,  maybe  for  the  first  time,  the  in¬ 
teractive  results  of  what  previously  has 
been  represented  by  two-dimensional  ta¬ 
bles  of  data  and  thousands  of  compli¬ 
cated  equations 

11.  Virtual  prototypes  can  provide  develop¬ 
mental  and  operational  testers  with  the 
ability  to  conduct  meaningful  evaluations 
that  can  aid  in  the  design  of  the  tests  per¬ 
formed  during  each  phase  of  an  acquisi¬ 
tion.  A  virtual  prototype  that  is 
developed  as  a  scientific  visualization  in 
the  Concept  Exploration  and  Develop¬ 
ment  phase  and  is  enhanced  continu¬ 
ously  throughout  the  development 
process,  can  provide  the  test  community 
with  the  ability  to  optimize  the  number  of 
tests  that  are  conducted  as  well  as  reduce 
the  time  needed  to  collect  required  data. 
Because  virtual  prototypes  exist  in  a  digi¬ 
tal  world,  the  tester  will  have  the  oppor¬ 
tunity  to  conduct  numerous  iterations  of 
the  same  test  scenario  and  aid  in  the  de¬ 
sign  of  tests  performed  during  each 
phase  of  the  acquisition  process.  Substi¬ 
tuting  a  virtual  prototype  for  a  physical 
prototype  in  all  or  some  portion  of  the 
tests  which  involve  destructive  testing 
and  fatigue  analysis,  can  allow  the  tester 
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to  "dry  nin"  test  scenarios,  optimize  tests 
for  a  physical  prototype,  determine  prac¬ 
tical  test  limitations  and  in  many  cases  ac¬ 
tually  conduct  additional  tests  that  may 
not  be  affordable  without  virtual  proto¬ 
types. 

An  even  more  productive  and  affordable 
test  alternative  might  be  to  use  virtual 
prototypes  to  evaluate  the  system  with¬ 
out  building  any  physical  prototypes. 
Based  on  commercial  as  well  as  military 
contractor  experience,  the  current  virtual 
prototyping  capabilities  will  eliminate  the 
test  community's  need  for  most  physical 
prototypes,  especially  in  the  DOD  acqui¬ 
sition  phases  prior  to  engineering  and 
manufacturing  development 

12.  Concurrent  engineering,  when  properly 
implemented,  will  result  in  products 
which  incorporate  state-of-ttie-art  tech¬ 
nology  to  satisfy  customer  needs  and 
manufacturing  capabilities.  It  is  being 
used  successfully  by  a  growing  number 
of  companies,  and  is  a  prerequisite  to  fu¬ 
ture  success.  Companies  not  embracing 
concurrent  engineering  during  the  19905 
may  find  themselves  outdated  and  pro¬ 
ducing  what  the  customer  no  longer 
wants. 

13.  Successful  implementation  of  virtual  pro¬ 
totyping  requires  a  commitment  from 
senior  management.  Converting  to  digi¬ 
tal  design  concepts  is  a  major  cultural 
change  for  most  companies  and,  as  such, 
requires  top-level  commitment  to  see  it 
through  the  conversion  process. 

14.  The  modeling  and  simulation  infrastruc¬ 
ture  within  DOD  needs  to  be  improved. 
This  is  a  major  challenge  since  the  neces¬ 
sary  infrastructure  is  not  well  developed. 
Individual  disdpline-oriented  simulation 
tools  exist  but  most  are  embedded  in  spe¬ 


cialized  orgaiuzations.  Data  communica¬ 
tion  standards  and  tools  do  not  exist  to 
exploit  the  broad  range  of  tools  required 
in  weapon  system  and  manufacturing 
process  design.  Interoperability  of  mod¬ 
els  and  simulations  across  services  is  not 
well  developed. 

15.  If  distributed  interactive  simulation  is 
used  to  make  acquisition  decisions,  the 
elements  of  the  simulation  network  need 
to  provide  an  envirorunent  sufficiently 
accurate  so  results  can  be  used  with  con¬ 
fidence.  Participating  weapons  systems 
need  to  reflect  accurately  system  capabili¬ 
ties  and  characteristics  in  a  realistic  and 
accurate  synthetic  environment.  Verifica¬ 
tion,  vali^tion  and  accreditation  is  re¬ 
quired  of  boto  weapon  systems  and 
synthetic  environments. 

16.  Knowledge  gained  by  using  virtual  proto¬ 
types  will  enhance  the  fundamental  im- 
derstanding  of  systems,  subsystems  and 
manufacturing  processes  and  make  it  eas¬ 
ier  to  optimize  designs  for  performance, 
produdbility  and  reliability. 

17.  The  risks  of  simulation  should  not  be 
overlooked.  Designers  of  virtual  proto¬ 
types  must  understand  the  critical  as¬ 
sumptions  contained  in  simulations. 
They  can  either  accept  validated  pro¬ 
grams  or  they  must  check  the  results  in 
sufficient  depth  to  ensure  that  the  pro¬ 
grammer  did  not  make  dangerous  as- 
siunptions  or  omit  critical  factors  and 
that  the  programmer  reflects  fully  the 
subtleties  of  the  designer's  unique  prob¬ 
lems. 

RECOMMENDATIONS 

Acquisition  Policy 

1.  Virtual  prototypes  should  be  utilized  in 
lieu  of  physical  prototypes  whenever  pos¬ 
sible,  and  dual-use  funding  should  be  tar- 
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geted  in  this  area  to  increase  industrial 
flexibility. 

2.  Virtual  reality  has  great  potential,  but  it  is 
not  clear  when  DOD  will  benefit  from 
this  technology.  Virtual  reality  research 
should  be  continued  to  facilitate  its  incor¬ 
poration  once  it  matures. 

3.  An  oiganization  needs  to  be  established 
that  is  formally  assigned  the  responsibil¬ 
ity  for  establishing  standards  and  com¬ 
mon  tools  for  verification,  validation  and 
accreditation  of  all  synthetic  environ¬ 
ments. 

4.  Rapid  prototyping  tools  and  techniques 
greatly  accelerate  the  development  of  a 
new  product  and  should  be  required  in 
contracts  for  parts  and  subsystems  wher¬ 
ever  possible.  The  use  of  stereolithogra¬ 
phy  anct  similar  technologies  should  be 
encouraged. 

5.  Software  development  tools  that  support 
the  rapid  construction  of  battlefield  simu¬ 
lations  need  to  be  developed.  Battlefield 
simulations  must  look  real  and  must  pre¬ 
sent  the  same  conditions  to  all  partici¬ 
pants.  The  enviroiunents  must  provide 
semiautomated  forces  which  mimic  hu¬ 
man  behavior.  Finally,  models  of  realistic 
human  performance  and  decision  making 
need  to  be  validated. 

6.  Virtual  prototypes  should  be  incorporated 
in  developmental  and  operational  test 
plans  as  a  substitute  for  physical  proto¬ 
types  whenever  possible  and  used  to  aid 
in  the  design  of  the  tests  performed  dur¬ 
ing  each  phase  of  an  acquisition.  A  vir¬ 
tual  prototype  can  provide  the  test 
community  wifli  the  ability  to  optimize 
the  number  of  tests  that  are  to  be  con¬ 
ducted  as  well  as  reduce  the  time  re¬ 
quired  to  collect  the  required  data. 


Testers  can  conduct  numerous  iterations 
of  the  same  test  scenario  to  assist  in  the 
design  of  the  tests  that  are  to  be  per¬ 
formed  during  each  phase  of  the  acquisi¬ 
tion  process.  Wherever  possible  a  virtual 
prototype  should  be  substituted  for  a 
physical  prototype  for  destructive  testing 
and  fatigue  analysis.  For  most  develop¬ 
ments  virtual  prototypes  should  be  used 
in  lieu  of  physical  prototypes  in  acquisi¬ 
tion  phases  prior  to  engineering  and 
manufacturing  development. 

7.  Establish  a  modeling  and  simulation  infra¬ 

structure  responsible  for  data  communi¬ 
cation  standards  and  tools  which  do  not 
exist  today. 

8.  Validate  and  verify  the  emeiging  DIS  envi¬ 

ronment  to  ensure  it  is  accurate  enough 
so  simulation  results  can  be  used  with 
confidence  to  support  acquisition  and 
training  decisions. 

Program  Managers 

1.  Virtual  prototypes  are  a  powerful  tool  for 
managing  program  risk.  Virtual  proto¬ 
types  should  be  used  wherever  possible 
to  measure  performance  against  mile¬ 
stone  decision  criteria.  They  can  be  used 
to  test  the  system  or  high-risk  subsystems 
against  simulated  threats,  assess  the  effec¬ 
tiveness  of  the  technology  and  also  to 
evaluate  the  feasibility  of  the  design  for 
producibility. 

2.  Make  virtual  prototyping  the  central  ele¬ 
ment  in  the  approach  to  development  and 
production.  Recjuire  a  virtual  prototype 
in  the  concept  evaluation  phase  and  en¬ 
hance  its  fidelity  throughout  tire  develop¬ 
ment  and  production  process.  Utilize  the 
virtual  prototype  to  adiieve  the  "seamless 
transition"  that  reduces  schedule  and 
start-up  costs. 
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3.  Educate  the  functional  matrix  team  mem¬ 
bers  on  the  benefits  realized  from  using  a 
virtual  prototype  and,  whenever  possible, 
reduce  or  eliminate  interim  paper  reports 
and  replace  them  with  access  to  the  digit¬ 
ized  database  that  supports  the  virtual 
prototype.  Maximize  the  use  of  simula¬ 
tions  widi  the  virtual  prototype  to  satisfy 
engineering,  manufacturing,  testing  and 
logistical  requirements,  wherever  possi¬ 
ble. 

4.  Convert  your  drawing  approval  and  con¬ 
figuration  management  procedures  to  a 
process  that  is  digital  and  utilizes  the 
evaluation  of  the  virtual  prototype  as  the 
mechanism  through  which  these  tasks  are 
accomplished.  Two-dimensional  paper 
drawings  should  be  replaced  by  three-di¬ 
mensional  digital  desigirs  that  can  be 
used  to  assemble  the  product  electroni¬ 
cally.  Emulation  can  then  be  added  to 
validate  maintenance  procedures  and  hu¬ 
man  factors. 

5.  Virtual  prototypes  are  useful  in  obtaining 
and  maintaining  system  support  They 
can  positively  influence  product  support 
at  all  levels  of  the  acquisition  process. 
Use  virtual  prototypes  to  demorrstrate  the 
"value-added"  capabilities  of  your  sys¬ 
tem  while  at  the  same  time  convincing 
the  audience  that  the  technical  and  finan¬ 
cial  risks  associated  with  obtaining  this 
capability  are  reasonable.  Increase  user 
involvement  in  the  development  process 
by  providing  a  better  foundation  for  user 
and  developer  communications. 


6.  Virtual  prototypes  will  permit  testing  sys¬ 
tems  in  a  simulated  battlefield  at  a  very 
early  stage  in  the  development  and  thus 
allow  optinuzing  the  design  for  maxi¬ 
mum  "value-added"  wartighting  capabil¬ 
ity. 

7.  Virtual  prototyping  capabilities  maximize 
the  potential  for  dual-use  products  and 
processes  and,  as  such,  program  manag¬ 
ers  should  seek  additional  funding  from 
the  DOD  dual-use  program. 

Industry 

1.  Virtual  prototyping  provides  a  clear,  com¬ 
petitive  edge  to  companies  who  embrace 
and  successfully  implement  it.  Encourage 
and  support  its  use  at  every  opporhmity. 

2.  Concurrent  engineering  is  an  absolute  re¬ 
quirement  for  competitiveness  in  the 
1990s.  Virtual  prototyping  will  facilitate 
the  adoption  of  this  concept. 

3.  Develop  the  virtual  prototype  as  early  as 
possible  and  use  it  in  internal  and  exter¬ 
nal  marketing  efforts.  Make  the  virtual 
prototype  database  the  vehicle  for  facili¬ 
tating  timctional  communications  and  the 
basis  from  which  a  "seamless"  product 
development  and  production  process  can 
be  implemented. 

4.  Senior  management  support  is  required  in 
order  to  successfully  implement  the  use 
of  virtual  prototyping,  lire  conversion  to 
digital  design  concepts  will  involve  a  ma¬ 
jor  cultural  change  and  a  significant  tran¬ 
sition  period  should  be  allowed  before 
mandatory  conversion. 
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Color  Plate  1.  Advanced  Computer-Aided  Design  (Examples) 
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Color  Plate  2.  Examples  of  Meshing  Techniques 
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Color  Plate  3.  Finite  Element  Analysis  (Example) 
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Zealous  Pursuit  Simulators 
and  Physical  Locations 
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Color  Plate  4.  Zealous  Pursuit  Exercise 
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Color  Plate  5.  Comanche  Helicopter 
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Color  Plate  6.  Computer  Analysis  of  Engine  Parts 
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Color  Plate  7.  Dual  Cockpit  Simulation  with  Head-Mounted  Display 
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Color  Plate  8.  Reconfigurable  Multifunction  Displays  in  Cockpit 
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Color  Plate  9.  Virtual  Kitchen 
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Color  Plate  10.  Virtual  Molecule  Docking 
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Appendix  A 

INTERVIEW  QUESTIONNAIRE 

Parti:  Background  Information 


1.  Organization: 

2.  Address: 

3.  Date  of  interview: 

4.  Name: 

5.  EHityhde: 

6.  Phone  number: 

7.  Type  of  organization? 

a.  Govemmentresearchactivity 

b.  Government  purchasing  organization 
c  University 

d.  Design  and  manufacturing  company 

e.  Software  organization 

f.  Other 

8.  What  best  describes  your  position? 

a.  Marketing 

b.  Product  design 
c  Software 

d.  Manufacturing  Engineer 

e.  Research 

f.  Other 

9.  How  many  years  have  you  been  with  your  organization? 

a.  Less  than  5 

b.  5-10 

c.  More  thrji  10 
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Part  n:  Familiarity  with  Virtual  Prototyping 

A  virtual  prototype  is  a  computer-based  simulation  of  a  system  or  subsystem  with  a  degree  of 
functional  realism  tttat  is  comparable  to  a  physical  prototype.  Virtual  prototyping  must  facili¬ 
tate  immersion  and  navigation.  A  virtual  prototype  may  be  used  in  lieu  of  a  physical  prototype 
for  product  design,  test  and/or  evaluation  of  spedfic  characteristics  of  a  candidate  design. 

The  following  questions  pertain  to  your  experience  and  your  oiganization: 

1.  Are  you  familiar  with  the  concept  of  virtual  prototyping  as  1  just  described  it? 


2.  Please  indicate  the  extent  your  oiganization  is  using  virtual  prototyping  on  overall  sys 


terns  and  on  the  spedtied  subsystems: 

NotAtAU 

Some 

A  Great  Deal 

a.  Entire  system 

N 

S 

AGD 

b.  Subsystems 

N 

S 

AGD 

(1)  Structures 
(fuselage, 
tank  body) 

N 

s 

AGD 

(2)  Mechanical 

(power  plant,  gears) 

N 

s 

AGD 

(3)  Electrical 

(motors,  batteries, 
power  lines) 

N 

s 

AGD 

(4)  Electronic 

(displays,  computers, 
Ere  control) 

N 

s 

AGD 

(5)  Comical 

(composites,  paints) 

N 

s 

AGD 

3.  How  would  you  characterize  manufacturing  at  your  company? 

a.  Capital  intensive 

b.  Labor  intensive 
c  Don't  know 

d.  Does  not  apply 

If  not  involved  in  virtual  prototyping,  STOP  HERE. 
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4.  In  your  opinion  what  are  the  most  significant  advantages  and  disadvantages  of  virtual 
prototyping? 

5.  For  what  purpose  are  you  using  virtual  prototyping? 

6.  What  is  the  primary  reason  why  your  organization  is  involved  with  virtual  prototyping? 

a.  Competition 

b.  Cost  reduction 

c  Reduce  design  time 

d.  Other 

e.  Not  involved 

7.  Listed  below  are  several  statements  related  to  virtual  prototyping.  Please  indicate  if  you 
agree  (A),  disagree  (D),  or  don't  know  (DK)  regarding  each  statement. 


Agree 

Disagree 

Don’t  Know 

a.  Virtual  prototyping  reduces 
design  costs. 

A 

D 

DK 

b.  Wrtual  prototyping  reduces 
design  time. 

A 

D 

DK 

c  Virtual  prototyping  produces 
more  robust  designs. 

A 

D 

DK 

d.  Vrtual  prototyping  makes  it 
easier  to  transition  from 
design  to  production. 

A 

D 

DK 

e.  Virtual  prototyping  makes  it 
easier  to  test  prototyjjes. 

A 

D 

DK 

f.  The  defense  industry 
is  lagging  the  commercial 
sector  in  the  utilization  of 
virtual  pn)tot)rping. 

A 

D 

DK 

g.  U.S.  industry  is  behind 
foreign  firms  in  the  use 
of  virtual  prototypes. 

A 

D 

DK 

h.  Virtual  prototyping  makes 
it  easier  to  create  a  model 
of  a  new  product. 

A 

D 

DK 
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Agree  Disagree  Don’t  Know 

i.  Virtual  prototyping  fadii'  A  D  DK 

tates  customer  feedback. 

8.  To  your  knowledge,  who  else  is  using  virtual  prototyping  in  your  oiganization? 


9.  How  significant  are  the  following  factors  in  the  use  of  virtual  prototypes  on  systems 


and  subsystems? 

Not  Significant 

Significant 

Don’t  Know 

a.  Suitability  of 
system/ subsystem 
to  virtual  prototyping. 

S 

NS 

DK 

b.  Software  expertise 
in  your  organization. 

S 

NS 

DK 

c  Commitment  of  top 
management. 

s 

NS 

DK 

d.  Competition. 

s 

NS 

DK 

e.  Organizational  support 

s 

NS 

DK 

10.  Do  you  think  that  virtual  prototyping  will  replace  physicd  prototypes  in  tiie  future  for 
systems  and  the  following  specified  subsystems? 


A  Great 

Don't 

No 

Somewhat 

Deal 

Know 

a.  Entire  system 

b.  Subsystems: 

N 

S 

AGD 

DK 

(1)  Structures 

N 

S 

AGD 

DK 

(2)  Mechanical 

N 

s 

AGD 

DK 

(3)  Ekctrical 

N 

s 

AGD 

DK 

(4)  Electronic 

N 

s 

AGD 

DK 

(5)  Chemical 

N 

s 

AGD 

DK 
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11.  The  following  statement  refers  to  the  validation  of  a  virtual  prototype.  Validation  is  the 
process  of  determining  (a)  the  manner  and  degree  to  whidi  a  model  is  <m  accurate  repre¬ 
sentation  of  the  real  world  from  the  perspective  of  the  intended  uses  of  the  model  emd  (b) 
the  cotrfidence  that  should  be  placed  on  this  assessment.  How  much  coirhdence  do  you 
have  that  virtual  prototypes  are  an  accurate  representation  of  the  real  world  for  entire  sys¬ 
tems  and  the  spedhed  subsystems? 


A  Great 

Don't 

None 

Somewhat 

Deal 

Know 

a.  Overall  system 

b.  Subsystems: 

N 

S 

AGD 

DK 

(1)  Structures 

N 

S 

AGD 

DK 

(2)  Mechanical 

N 

s 

AGD 

DK 

(3)  Electrical 

N 

s 

AGD 

DK 

(4)  Electronic 

N 

s 

AGD 

DK 

(5)  Chemical 

N 

s 

AGD 

DK 

Part  XU:  DOD  Policy  Implications 

The  questions  in  Part  HI  apply  to  DOD  contractors  only.  If  you  are  not  a  DOD  contractor, 
please  skip  to  Part  IV. 

1.  In  your  opinion,  does  current  DOD  policy  have  any  impact  on  your  decision  to  use  virtual 
prototypes? 

a.  Yes,  a  significant  impact. 

b.  Yes,  some  impact. 

c.  No. 

d.  Don't  know. 

2.  Should  DOD  modify  its  current  acquisition  policy  to  encoiuage  the  use  of  virtual 
prototyping?  If  yes,  what  changes  do  you  recommend? 

3.  Should  DOD  modify  its  current  DODD  5000.1  and  DODI 50002  milestone  decision  process 
based  on  the  impact  of  virtual  prototyping?  If  yes,  what  changes  do  you  recommend? 
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4.  Listed  below  are  several  statements  relating  to  virtual  prototypes  (VP)  on  defense  systems 
and  subsystems.  For  each  of  these  statements  please  indicate  whether  you  Agree  (A),  Dis¬ 
agree  (D)  or  Don't  Know  (DK). 

Agree  Disagree  Don't  Know 

a.  VP  will  replace  physical  A  D  DK 

prototypes  for  entire 

s3retems  by  the  year  2(XX). 

b.  VP  will  replace  physical  prototypes  for  the  following  subsystems  by  the  year  2000: 


(1)  Structures 

A 

D 

DK 

(2)  Mechanical 

A 

D 

DK 

(3)  Electrical 

A 

D 

DK 

(4)  Electronic 

A 

D 

DK 

(5)  Qiemical 

A 

D 

DK 

Part  IV:  Application  of  Virtual  Prototyping 

1.  Please  identify  the  systems/ subsystems  on  which  you  have  used  virtual  prototyping. 

2.  What  has  been  your  experience  with  virtual  prototyping? 

3.  What  is  your  assessment  of  the  future  of  virtual  prototyping  at  your  company  and  in  your 
industry? 
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Appendix  B 

INTERVIEWS  AND  PERSONAL 
CONTACTS 


Dt  George  P.  Abrahamson 
Chief  Scientist  of  the  Air  Force 
The  Pentagon,  Room  4E320 
Washington,  DC  20301 

Me  Nick  All 

Program  Manager  CCTT 

International  Business  Machines  Corporation 

30S1  Technology  Parkway,  Suite  100 

Oriando,  FL  23826 

Lt  Col  Philip  Ambum,  USAF 
Instructor  of  Computer  Science 
Air  Force  Institute  of  Technology 
Wright-Patterson  AFB,  OH  45433-6583 

Me  Michael  R.  Anderberg 

Office  of  the  Assistant  Secretary  of  Defense 

Programs,  Analysis  and  Evaluation 
(Resource  Analysis) 

The  Pentagon,  Room  2D278 
Washington,  DC  20301 

Mr&  Joan  E.  Bebb 
Chief  Engineer 

TRW  Systems  Engineering  and 
Development  Division 

18901  South  IMlmington  Avenue 
Carson,  CA  90746 


Me  Hancel  Beckworth 
Principle  Systems  Analyst 
Eagle  Technology/ Logicon 
10560  Arrowhead  Drive 
Fairfax,  VA  22030 

Me  Michael  A.  Bifemo 
Senior  Engineer/Scier*' 

McDonnell  Douglas  Transport  Aircraft 
Internal  Mail  Code  78-73 
3855  Lakewood  Blvd. 

Long  Beach,  CA  90846 

Major  Joseph  E  Bond,  USAF 
I>efense  Modeling  and  Simulation  Office 
1901  N.  Beaiuegard  Street,  Suite  504 
Alexandria,  VA  22311 

De  William  Bricken 
Principle  Scientist 

Human  Interface  Technology  Laboratory 
Washington  Technology  Center 
University  of  Washington 
Seattle,  WA  98195 
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Dc.  Harold  K.  Brown 

Associate  Professor  of  Electrical 
and  Computer  Engineering 

Florida  Institute  of  Technology 
150  West  University  Blvd. 
Melbourne,  FL  32901-6988 

BG  (P)  WiUiam  H.  Campbell,  USA 

Program  Executive  Officer, 
Command  and  Control 

Fort  Monmoutir,  NJ  07033 

Mr.  Wendell  Chun 

Robotic  Systems,  Civil  Space  and 
Communications 

Martin  Marietta 
P.O.  Box  179 
Denver,  CO  80201 

Dr.  Earl  J.  Craighill 

Program  Manager,  Network 
Information  System 

SRI  International 
333  Ravenswood  Avenue 
Menlo  Park,  CA  94025 

Mr.  Rich  Crispo 

Manager,  Engineering  Computing 
The  Boeing  Company 
Boeing  Defense  and  Space  Group 
P.O.  Box  3999,  MS  87-84 
Seattle,  WA  98124-2499 


Mx.  Benjamin  E  Cummings 
U.S.  Army  Research  Laboratory 
ATTN:  AMSRUCI-S 

Aberdeen  Proving  Ground,  MD  21005-5066 

Mr.  Michael  J.  Daily 
Senior  Member  of  the  Technical  Staff 
Hughes  Perception  Systems 
Research  Laboratories,  MS  9L% 

3011  Malibu  Canyon  Road 
Malibu,  CA  90265-4799 

Mr.  Michael  Dominguez 

Office  of  the  Assistant  Secretary  of  Defense 

Programs,  Analysis  and  Evaluation 
(Resource  Analysis) 

The  Pentagon,  Room  3E836 
Washington,  DC  20301 

Brig  Gen  Robert  W.  Drewes,  USAF 

Director,  Contracting  and 
Manufacturing  Policy 

Office  of  the  Secretary  of  the  Air  Force 
ATTN:  SAF/AQC 
The  Pentagon,  Room  4C261 
Washington,  DC  20301 

Mr.  David  S.  Eccles 

Director,  Computer-Aided  Engineering  Dept. 
The  Aerospace  Corporation 
2350  E.  El  Segundo 
El  Segundo,  CA  90245-4691 
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Mr.  Robert  (Didc)  Eddy 
General  Dynamics,  Electric  Boat  Division 
75  Eastern  Point  Road,  Mail  Stop  C62-3 
Groton,  CT  063404989 

Dr.  Robert  Eggleston 
Armstrong  Laboratoiy 
ATTN;  WL/CFHP 

Wright-Patteison  AFB,  OH  45433-6573 

Mr.  Ronald  D.  Etcher 

Senior  Group  Leader 

Martin  Marietta  Denver  Aerospace 

P.O.  Box  179 

Denver,  CO  80201 

Dr.  Eugene  S.  Ferguson 
Professor  of  History  Emeritus 
University  of  Delaware 
54  Winslow  Road 
Newark,  DE  19711 

Mr.  Michael  J.  Ferranti 

Flight  Simulation  Facility  Supervisor 

Sikorsky  Aircraft 

Mail  Stop  S325A 

6900  Main  Street 

Stratfoni,CT  06601-1381 

Mr.  Kurt  D.  Fickie 

U.S.  Army  Research  Laboratoiy 

ATTN:  AMSRLCI-S 

Aberdeen  Proving  Ground,  MD  210(6-5066 


Mn  Brian  C.  Fleming 
Manager,  Sdentihc  Applications  Group 
CAD-PRO  Systems,  Inc 
8101  E.  Prentice,  Suite  300 
Englewood,  CO  80111 

Dr.  Thomas  A.  Furness  III 
Director 

Human  Interface  Technology  Laboratoiy 
Washington  Technology  Center 
University  of  Washington,  FJ-15 
Seattle,  WA  98195 

Dn  Jacques  S.  Gansler 

Senior  Vice  President 

The  Anal3dic  Sciences  Corporation  (TASC) 

1101  Wilson  BlvdL,  Suite  1500 

Arlington,  YA  22209 

Mr.  Todd  R.  Gerhardt 

Manager,  Advanced  Engineering  Systems 

Kohler  Company 

444  Highland  Drive 

Kohler,  WI  53044 

Mn  Brian  F.  Goldiez 
Director,  Research  and  Development 
Institute  for  Simulation  and  Training 
University  of  Central  Florida 
12424  Research  Parkway,  Suite  3(X) 
Orlando,  FL  32826 
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Mi:  Tenence  D.  Gossett 
Chief,  Simulation  &  Aircraft  Systems  Division 
Ames  Research  Center  MS.  243-4 
Moffett  Field,  CA  94035-1000 

Mn  Dick  Hartke 

AercKpace  Industries  Assoc  of  America 
National  Center  for  Advanced  Technology 
1250  Eye  Street  NW 
Washington,  DC  20005 

BC  Edward  Hirsch,  USA  (Ret) 

Provost  and  Deputy  Commandant 
Defense  Systems  Management  College 
Fort  Belvoir,  VA  22060-5565 

Dr.  Ronald  C.  Hofer 
Technical  Director 

Simulation,  Training  and 
Instrumentation  Command 

12350  Research  Parkway 
Oilando,  FL  32826-3276 

Mr.  Stephen  B.  Holdener 
Customer  Relations 
The  Boeing  Company 
Boeing  Defense  and  Space  Croup 
P.O.  Box  3999,  MS  85-11 
Seattle,  WA  98124-2499 

Ms.  Linda  A.  Houseman 
Research  Associate 
University  of  North  Carolina 
Box  3175  Sitterson  Hall 
Chapel  HiU,NC  27599-3175 


Mr.  Richard  D.  James 

Manager,  Research  &  Engineering  Programs 

The  Boeing  Company 

Boeing  Defense  and  Space  Group 

1700  North  Moore  Street,  20th  Floor 

Rosslyn,  VA  22209-1989 

Mr.  Jim  Kagdis 
Director  of  Marketing 
Boeing-Sikorsky 
JPO  Commanche 
Trumbull,  CT  06611 

Mr  David  L  Kellogg 
Engineering  Staff  Specialist 
General  Dynamics 
P.O.  Box  478 
Fort  Worth,  TX  76101 

LTC  David  E.  Kendrick,  USA 
Office  of  the  Secretary  of  the  Army 
Research,  Development  and  Acquisition 
The  Pentagon,  Room  3E411 
Washington,  DC  20301 

Mr  Jim  Koenig 
Senior  Engineer/Scientist 
Douglas  Aircraft  Company 
Internal  Mail  Code  78-73 
3855  Lakewood  Blvd. 

Long  Beach,  CA  90846 
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Dt.  Walter  B.  LaBerge 
Holder,  Acquisition  Policy  Chair 
Defense  Systems  Management  College 
FortBelvoir,VA  22060-5565 

Dr.  Hng  T.  Le 
Systems  Engineer 

International  Business  Machines  Corporation 
9500  Godwin  Drive 
Manassas,  VA  22110 

Ms.  Evelyn  Lemon 

Systems  Manager,  Information  Systems 
Port  of  Seattle,  Pier  66 
P.O.  Box  1209 
Seattle,  WA  98111 

Dr.  Allan  J.  Lightman 

Research  Physicist 
University  of  Dayton 
Research  Institute  KL-462 
300  College  Park 
Dayton,  OH  45469-0140 

Mr.  James  A.  Mains 
Manager,  Engineering  Visualization 
TRW  Engineering  and  Test  Division 
One  Space  Park 
Redondo  Beach,  CA  90278 


Dn  William  S.  Mark 
Chief  Scientist 

Lodcheed  Missiles  and  Space  Company,  Inc 
Oig  964)1,  Bldg  254E 
3251  Hanover  Street 
Palo  Alto,  CA  94304-1191 

Mr.  Charles  E.  Massey 
Systems  Engineering  Manager 
International  Business  Machines  Corporation 
9500  Godwin  Drive 
Manassas,  VA  22110 

Mr.  Grant  McMillian 

Chief,  Performance  Assessment  and  Interface 
Technology 

Armstrong  Laboratory 
ATTN:  WL/CFHP 

Wright-PattersonAFB,OH  45433-6573 

Dr.  Peter  M.  Meenan 

Manager,  Computer  Graphics  and 
Systems  Program 

General  Electric  Company 
Bldg.  KW,  Room  C217 
P.O.  Box  8 

Schenectady,  NY  12301 

Mn  W.  M.  (Max)  Mercer 

Manager,  Combat  Systems  Trainer 
Engineering 

International  Business  Machines  Corporation 
9500  Godwin  Drive 
Manassas,  VA  22110 
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Lieutenant  Colonel  Erik  G.  Mettala^  USA 

Defense  Advanced  Research  Projects  Agency 
(SISTO) 

\^iginia  Square  Station 
3701 N.  Fairfax  Drive 
Arlington,  VA  22203-1714 

Mi.  Richard  Moore 
Director  of  Process  Engineering 

TRW  Systems  Engineering  &  I>evelopment 
Division 

1800  Glenn  Curtis  Drive 
P.O.Box  6213 
Carson,  CA  90749-6213 

Di  j.  Michael  Moshell 
Associate  Professor  of  Computer  Science 
Institute  for  Simulation  and  Training 
University  of  Central  Florida 
12424  Reseeu^  Parkway,  Suite  300 
Orlando,  FL  32816 

Di  Donald  L.  Nielson 

Vice  President,  Computing  and  Engineering 

SRI  International 

333  Ravenswood  Avenue 

Menlo  Park,  CA  94025 

Mi  Cecil  Patterson 
Director  Iidormation  Systems 
Port  of  Seattle,  Pier  66 
P.O.  Box  1209 
Seattle,  WA  98111 


Mi  Joseph  Rhyu 
3D  CAM  Corporation 
21000  Osborne  Street,  Suite  4 
Kenova  Park,  CA  91304 

Mi  Steve  Rice 
Senior  Engineer/ Scientist 
McDoimell  Douglas  Transport  Aircraft 
Internal  Mail  Code  78-73 
3855  Lakewood  Blvd. 

Long  Beach,  CA  90846 

Di  Dana  B.  Rogers 
Professor 

University  of  Dayton 
Electrical  Engineering  Department 
300  College  Park 
Dayton,  OH  45469-0150 

Captain  'limothy  E  Rohaly,  USA 
U.S.  Army  Research  Laboratory 
ATTN:  AMSRL-CI-S 

Aberdeen  Proving  Ground,  MD  21005-5066 

Mi  Walker  Royce 
Project  Manager 

TRW  Systems  Engineering  &  Development 
Division 

1800  Glerm  Curtis  Drive 
P.O.  Box  6213 
Carson,  CA  90749-6213 
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Mt  Dennia  W.  Ruhl  Mi:  Ernie  Smart 

Senior  Engineer  Advanced  Applications  Manager 

International  Biisiness  Machines  Corporation  Institute  for  Simulation  and  Training 
Dept.  41HC  M/S  630  University  for  Central  Florida 

Neighborhood  Road  12424  Research  Parkway,  Suite  300 

Kingston,  NY  12401  Oiiando,  FL  32826 


Mn  Greg  Saunders 
Deputy  Director 

OASD  (Production  and  Logistics)PR/MM 
The  Pentagon,  Room  3B253 
Washington,  DC  20301 

Dr.  William  J.  Schroeder 
Computational  Scientist 
General  Electric  Company 
Bldg.  KW,  Room  C211 
P.O.  Box  8 

Schenectady,  NY  123ci 

Dc.  Wade  H.  Shaw  Ji. 

Professor 

Florida  Institute  of  Technology 
150  West  University  Boulevard 
Melbourne,  FL  32901-6988 

Me.  R.  Keimeth  Sigmund 

Federal  Sector  Marketing 

International  Business  Machines  Corporation 

6705  Rockledge  Drive 

Rockville,  MD  20817 


De  John  R.  Spofford 

Research  Scientist  Robotics  Section 
Martin  Marietta  Space  Systems 
P.O.  Box  179 
Denver,  CO  80201 

Me.  Ram  Sriram 

Group  Leader,  Artificial  Intelligence  Center 
Lockheed  Missiles  and  Space  Company,  Inc 
Oig  96-20,  Bldg  254 
3251  Hanover  Street 
Palo  Alto,  CA  94304-1191 

Mr.  Dennis  D.  Stafford 
Division  Head 
University  of  Dayton 

Electrical  and  Computer  Engineering  Division 
300  College  Park 
Dayton,  OH  45469-0150 

Mr:  Mike  Sutten 
Manager,  Business  Development 
General  Electric  Company 
ATL  Building 

Moorestown  Corporate  Center 
Moorestown,  NJ  08057 
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Mk  Giegoiy  D.  Swedberg 
Section  Manager,  CAE  E)ept. 

The  Aerospace  Corp. 
2350E.ElSegundoBlvd. 
ElSegundo,CA  902454691 

Mn  David  E  Teti 
Division  Inc. 

400  Seaport  Court,  Suite  101 
Redwood  Qty,  CA  94063 

Mn  Edwin  A.  Iner 
Deputy  Project  Manager  CATT 

Simulation,  Training  and 
Instrumentation  Command 

ATTN:  AMCPM-CATT 
12350  Research  Parkway 
Oriando,  FL  32826-3276 

Dn  David  Y.  Tseng 

Laboratory  Manager 

Hughes  Artificial  Intelligence  Center 

Research  Laboratories,  Loc.  MA,  Bldg  25 

3011  Malibu  Canyon  Road 

Malibu,  CA  902654799 


Dn  Bernard  J.  Ulozas 
Training  Specialist 
United  States  Navy 

Instructional  Technology  Division  (Code  152) 

Navy  Personnel  Research  and 
Development  Center 

San  Deigo,  CA  92152-6800 

Mn  Gary  Vassighi 
President 

3D  CAM  Corporation 
21000  Osborne,  Suite  4 
Canoga  Park,  CA  91304 

Mr.  Bruce  \^Mght 

Senior  Tedmical  Specialist  Avionics 
Northrop  Corporation 
8900  E.  Washington  Blvd. 

Pico  Rivera,  CA  90660-3765 

>hn  S.  Yuhas 

.  of  the  Secretary  of  the  Army 
Research,  Development  and  Acquisition 
The  Pentagon,  Room  3E479 
Washington,  DC  20301-0103 
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Appendix  C 

MODELING  AND  SIMULATION 
POINTS  OF  CONTACT 


ARMY: 

COL  David  Hardin,  USA 

U.S.  Army  M&S  Management  Office 

1725  Jefferson  Davis  Highway,  Sviite  808 

Arlington,  VA  22202 

703^7-3375  Office 

703-607-3381  Fax 

NAVY: 

CAPT  Tom  L.  Ttavis,  USN 
Office  of  the  CNO 

Modeling  &  Analysis  Section  (N812D) 

2000  Navy  Pentagon,  Room  4A520 
Washington,  DC  20350-2000 
703-697-3642  Office  (DSN  227-3642) 
703-693-9760  Fax  (DSN  223-9760) 

AIR  FORCE: 

Ms.  Peggy  Gordon 

Air  Force  Modeling,  Simulation  &  Analysis 
Technical  Support  Division 
624  9th  Street  NW,  Suite  300 
Washington,  DC  2001-5303 
202-504-5339,  Ext.  101  Office 
202-504-5352  Fax 


MARINE  CORPS: 

COL  John  Kline,  USMC 

Marine  Corps  Modeling  &  Simulation 
Management  Office 

Training  &  Education  Division 
2006  Hawlcins  Drive 
C^antico,  VA  22134 
703-640-2498  Office 
703-640-2591  Fax 

JOINT  STAFF  a-7): 

COL  Ue  McFann,  USAF 
Joint  Chiefs  of  Staff,  J-7 
The  Pentagon,  Room  2B877 
Washington,  DC  20318-7000 
703-697-1133  Office 
703-693-7729  Fax 

JOINT  STAFF  (J-8): 

Mn  Bob  Halayko 

Joint  Chiefs  of  Staff,  J-8 

Resources  and  Joint  Programs  Division 

The  Pentagon,  Room  1D929 

Washington,  DC  20318-8000 

703-693-4600  Office 

703-693-4601  Fax 
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INTELUGENCE: 

Dk  Joe  Durham 

Director,  Missile  &  Space  Intelligence  Center 

Attn:  MSC-3B 

Redstone  Arsenal,  AL  35898 

205-876-4934  Office 

205-881-2537  Fax 

DARPA: 

COL  Bob  Reddy,  USA 
DARPA-DIRO 
3701  N.  Fairfax  Drive 
Arlington,  VA  22203 
703-696-2362  Office 
703^96-2206  Fax 

DEFENSE  MODEUNG  & 

SIMULATION  OFnCE: 

CAFT  Bruce  P.  McQure,  USA 
Defense  Modeling  and  Simulation  Office 
1901  N.  Beauregard  Street,  Suite  504 
Alexandria,  VA  22131 
703-998-0660  Office 
703-9984)667  Fax 

OSD  (DT&E): 

COL  Charles  B.  Cook,  USA 
OSD,  DT&E 

The  Pentagon,  Room  3E1060 
Washington,  DC  20301 
703-695-4608  Office 
703-693-7030  Fax 


OASD  (PA&E): 

Dn  Patricia  Sanders 
OASD,  PA&E 
The  Pentagon,  Room  2B256 
Washington,  DC  20301 
703-697-3521  Office 
703-693-5707  Fax 

OSD  (DDR&E): 

Mr.  Rick  Menz 
DDR&E,  S&T/E&T 
The  Pentagon,  Room  3D1089 
Washington,  DC  20301 
703-695-0552  Office 
703-695-4885  Fax 

SDIO; 

Mr.  Stan  Sheldon 
SDIO 

The  Pentagon,  Room  1E149 
Washington,  DC  20371 
703-693-1594  Office 
703-693-1700  Fax 

OASD  (C3I): 

CDR  Charlotte  Gross,  USN 
OASD,C31 

1225  Jefferson  Davis  Highway,  Suite  910 
Arlington,  VA  22202 
703-746-7939  Office 
703-746-73%  Fax 
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OASD  (P&L): 
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Appendix  D 

GLOSSARY  OF  SELECTED  TERMS 


3-D  -  Three-dimensional,  refers  to  the  visual 
display  that  exhibits  breadth,  height  and 
thickness  or  depth.  Standard  2-D  computer 
images  and  television  displays  create  a  flat 
image  with  only  height  and  breadth. 

6  DOF  -  Six  degrees  of  freedom,  refers  to  the 
number  of  simultaneous  directions  or  inputs  a 
sensor  can  measure.  Typically  used  to  de¬ 
scribe  the  combination  of  spadal  positions  (X, 
Y,  Z)  and  orientation  (roll,  pitch,  yaw). 

Accreditation  -  An  official  determination  that 
a  model  is  acceptable  for  a  specific  purpose. 
Used  synonymously  wifli  certification. 

Augmented  Reality  -  Use  of  transparent  eye¬ 
glasses  on  which  data  can  be  projected.  This 
allows  a  user  to  operate  a  system  (fly  an  air¬ 
craft,  drive  a  tank)  while  having  needed  data 
displayed  in  the  direct  line  of  vision. 

CAD  -  Computer-aided  design,  a  precision 
software  drawing  tool  which  speeds  up  the 
design  process  by  automating  the  work. 

Computer  Models  and  Simulations  -  There 
are  three  broad  classes  as  follows: 

Computer  Models  -  Systems  and  forces 
and  ttieir  interaction  are  primarily  repre¬ 
sented  in  computer  code.  The  models 
can  differ  greatly  in  the  level  of  detail  of 
the  representation,  and  there  may  be 
some  interaction  widi  the  model  while  it 
is  running. 

Manned  V\feapon  System  Simulations  - 
Individual  weapon  systems  are  modeled 
(e.g.,  by  a  simulator)  and  typically  are 
controlled  by  a  human  operator.  Princi¬ 
pal  emphasis  is  on  the  situation  where 


the  individual  simulations  interact  to¬ 
gether  through  a  distributed  network. 
The  archetype  of  this  class  is  SIMNET. 

Instrumented  Tests  and  Exercise  - 
Troops,  weapon  systems,  and  support 
systems  interact  in  an  environment  as 
real  as  possible,  with  instrumentation 
being  used  to  collect  and  distribute 
status  data  on  the  force  elements.  Ac¬ 
tivities  at  the  National  Training  Center 
are  a  representative  example. 

Cybernetics  -  The  study  of  human  control 
functions  and  the  mechanical  and  electronic 
systems  designed  to  replace  or  emulate  them, 
including  computers.  "Cyber,"  as  a  prefix,  de¬ 
notes  anything  related  to  computer  environ¬ 
ments,  especially  things  that  involve 
extensive  interaction  by  the  user. 

Cyberspace  -  Any  shared  reality  based  com¬ 
puter  connections.  While  virtual  reality  is  a 
form  of  cyberspace,  cyberspace  is  not  a  virtual 
reality.  Also,  a  science-fiction  term  coined  by 
William  Gibson  in  his  book  Neuromancer  to 
describe  a  virtual  universe  wittun  a  global 
computer  network  allegorical  to  the  current 
telephone  system,  but  providing  a  multisen- 
sory  experience  of  "being  there,"  not  just  an 
auditory  experience. 

DataGlove  -  A  glove  wired  with  sensors  and 
connected  to  a  computer  system  for  gesture 
recognition.  DataGlove  is  a  trademark  of  VPL 
Research. 

Environment  -  In  virtual  reality  terms,  this  is 
a  computer^generated  model  that  can  be  ex¬ 
perienced  from  the  "inside"  as  if  it  were  a 
place. 
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Force  Feedback  -  An  output  device  that  trans¬ 
mits  pressure,  force  or  vibration  to  provide 
the  virtual  reality  participant  with  the  sense  of 
touch.  Force  fe^back  simulates  weight  or  re¬ 
sistance  to  motion. 

Haptic  -  Refers  to  all  the  physical  sensors  that 
provide  a  sense  of  touch  at  die  skin  level  and 
force  feedback  information  from  muscles  and 
joints. 

HMD  (head-mounted  display)  -  A  set  of  gog¬ 
gles  or  a  helmet  with  small  displays  in  front 
of  eadi  eye  that  generate  images,  seen  by  the 
wearer  as  being  3-dimensional. 

Immersion  -  When  one  or  more  of  a  virtual 
reality  participants  senses  (eyes  or  ears,  gen¬ 
erally)  are  isolated  from  the  surrounding  en¬ 
vironments  and  only  receive  information 
coming  from  a  computer-generated  environ¬ 
ment. 

LCD  -  Liquid  crystal  display,  used  in  products 
such  as  miniature  televisions,  portable  com¬ 
puters  and  wristwatches. 

LED  -  Light-emitting  diode,  a  small  semicon¬ 
ductor  device  that  generates  a  point  of  ligbf- 

Model  -  A  physical,  mathematical  or  other¬ 
wise  logical  representation  of  a  real-world 
systenv  entity,  phenomenon  or  process. 

Modeling  and  Simulation  Interoperability  - 
The  ability  of  a  model  or  simulation  to  pro¬ 
vide  services  to,  and  accept  services  from, 
other  models  and  simulations,  and  to  use  the 
services  so  exdianged  to  enable  them  to  oper¬ 
ate  effectively  together.  See  also  modeling 
and  simulation. 

Joint  modeling  and  simulation  is  the 
representations  of  joint  and  Service 
forces,  capabilities,  materials,  services, 
and  fadlities  used  in  the  joint  environ¬ 
ment  by  two  or  more  military  services. 


Common  use  modeling  and  simulation 
is  the  use  of  modeling  and  modeling  ap¬ 
plications,  services,  materials  or  facilities 
provided  by  a  DOD  component  to  two 
or  more  DOD  components. 

Multisensory  I/O  -  The  use  of  more  than  one 
sensory  mechanism  (visual,  aural,  tactile,  etc) 
to  interact  with  a  computer-generated  envi¬ 
ronment  See  virtual  interface. 

NTSC  -  National  Television  Standards  Con¬ 
vention,  the  television  standard  used  in  the 
United  States  and  ottier  parts  of  the  world. 
An  interlaced  signal  provides  two  fields  of  in¬ 
formation  in  a  single  frame,  with  a  total  of  525 
lines  of  horizontal  resolution,  eadi  l/30th  of  a 
second 

Ocdusion  -  The  vision  effect  of  doser  objects 
overlapping  or  occluding  more  distant  ones, 
providing  visual  dues  to  judge  how  close  ob¬ 
jects  are  from  the  viewer.  Slight  head  motions 
provide  more  information  about  ocdusions. 

Parallax  -  The  vision  effect  of  having  two  eyes 
viewing  the  same  scene  from  slightly  different 
positions  which  creates  a  sense  of  depth. 
Computer-generated  environments,  one  for 
each  eye,  attifidally  create  the  parallax  effect. 

Pixel  -  A  "picture  element,"  refers  to  the 
smallest  visual  unit  in  an  image  on  a  com¬ 
puter  display. 

Polygon  -  A  flat  plane  figure  with  multiple 
sides,  the  basic  building  block  of  virtual 
worlds.  The  more  polygons  a  computer  can 
display  and  manipulate  per  second,  the  more 
realistic  the  virtual  world  will  appear.  Hu¬ 
mans  perceive  the  equivalent  of  80  million 
polygons  at  more  than  30  frames  per  second 
in  normal  vision. 

Real  Time  -  The  ability  of  a  computer  simula¬ 
tion  to  respond  to  inputs  such  ^at  a  human 
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perceives  an  instantaneous  response,  typically 
less  than  50  milliseconds. 

Reality  Engine  -  Any  computer  system  spe¬ 
cifically  designed  to  generate  virtual  reality 
worlds. 

Rendering  -  The  computer  process  of  calcu¬ 
lating  and  drawing  computer  images  on  a  dis¬ 
play  device. 

Shutter  Glasses  -  Stereoscopic  viewing  eye¬ 
glasses  that  alternately  reveal  im  image  to  the 
left  and  right  eye  to  create  the  parallax  effect 
giving  a  sense  of  depdr  (each  eye  receives  a 
slightly  different  image).  The  shutters  are 
typically  composed  of  electrically  switehed 
L(ZD  or  Polaroid  material  and  have  no  mov¬ 
ing  parts. 

SIMNET  -  Simulation  Network  Project,  a  joint 
AREA  and  US.  Army  research  project  con¬ 
cerning  the  use  of  distributed  interactive 
simulation  on  local  and  wide  area  networks. 

Simulation  -  A  method  for  implementing  a 
model  over  time.  Also,  a  technique  for  testing, 
analysis  or  training  in  which  real-world  sys¬ 
tems  are  used,  or  where  real-world  and  con¬ 
ceptual  systems  are  reproduced  by  a  model. 
There  are  three  classes  of  simulation: 

Virtual  Simulation  -  Systems  simulated 
physically  and  electrorucally.  Examples 
indude  individual  aircraft  simulators 
and  virtual  prototypes. 

Constructive  Simulation  -  Indudes  war- 
games,  models  and  analytic  tools. 

Live  Simulation  -  Operations  with  real 
forces  and  real  equipment  Examples  in¬ 
clude  large  scale  live  exercises  sudi  as 
REFORGER  and  exercises  at  locations 
such  as  the  National  Ihiirung  Center. 


Synthetic  Battlefield  -  A  spedfic  application 
of  a  synthetic  environment  consisting  of 
simulations  of  the  components  of  an  actual 
battlefield  (air,  land  and/or  sea). 

Synthetic  Envirorunent  -  Intercormeded 
simulations  that  represent  activities  with  a 
high  level  of  realism  ranging  from  simula¬ 
tions  of  theaters  of  war  to  factories  and  manu¬ 
facturing  processes.  They  are  created  by  a 
confederation  of  computers,  connected  by  lo¬ 
cal  and  wide  area  networics  and  augmented 
by  super-realistic  spedal  effects  and  accurate 
behavioral  models.  They  allow  complete 
visualization  of,  and  total  immersion  into,  the 
environment  being  simulated  They  represent 
the  "real  world"  precisely. 

Telepresence  -  The  experience  of  being  in  an¬ 
other  location,  usually  created  by  remotely  lo¬ 
cated  sensors  (visual,  aural,  tactile)  and 
possibly  remote  manipulator  mechanisms. 

Validation  -  The  process  of  determining  the 
manner  and  degree  to  which  a  model  is  an  ac¬ 
curate  representation  of  the  real  world  from 
the  perspective  of  the  intended  uses  of  the 
model  and  the  confidence  that  should  be 
placed  on  this  assessment. 

Verification  -  The  process  of  determining  that 
a  model  implementation  accurately  represents 
the  developer's  conceptual  description  and 
specifications.  It  consists  of  two  basic  parts. 

Logical  and  mathematical  verification 
ensures  that  the  basic  equations,  algo¬ 
rithms,  etc,  are  as  the  designer  in¬ 
tended 

Code  verification  ensures  that  these 
representations  have  been  correctiy  im¬ 
plemented  in  the  computer  program,  in¬ 
cluding  verifying  that  computations  will 
not  be  erroneous  by  virtue  of  inappro¬ 
priate  numerical  techniques  or  other  im¬ 
plementation  decisions. 
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Virtual  -  Refers  to  the  essence  or  effect  of 
something,  not  the  fact. 

Virtual  Images  -  Visual,  auditory  and  tactile 
stimuli  that  are  trat\smitted  to  the  sensory  end 
organs  so  they  appeeir  to  origiiute  from 
within  the  three-diinei\sional  space  surround¬ 
ing  the  user. 

Virtual  Interface  -  A  system  of  transducers, 
signal  processors,  computer  hardware  and 
software  that  create  an  interactiv<  medium 
through  which  information  is  trairsmitted  to 
the  senses  in  the  form  of  three-dimensional 
virtual  itiutges.  The  psychomotor  and  physi¬ 
ological  behavior  of  the  user  is  monitored  and 
used  to  manipulate  the  virtual  images. 

Virtual  Prototype  -  A  computer-based  simula¬ 
tion  of  systems  and  subsystems  witti  a  degree 
of  functional  realism  comparable  to  a  physical 
prototype  that  facilitates  immersion  and  navi¬ 
gation.  Virtual  prototypes  are  used  for  test 


and  evaluation  of  specific  characteristics  of  a 
candidate  design. 

Virtual  Reality  -  The  effect  created  by  gener¬ 
ating  an  environment  that  does  not  exist  in 
the  real  world.  Usually,  a  stereoscopic  display 
and  computer-generated  three-dimensional 
environment  giving  the  immersion  effect. 
The  environment  is  interactive,  allowing  the 
participant  to  look  and  navigate  about  the  en¬ 
vironment,  enhancing  the  immersion  effect. 
Virtual  environment  and  virtual  world  are 
synonyms  for  virtual  reality. 

Visualization  -  The  formation  of  an  artificial 
image  that  cannot  be  seen  otherwise.  Typi¬ 
cally,  abstract  data  that  would  normally  ap¬ 
pear  as  text  and  numbers  is  graphically 
displayed  as  an  image.  The  image  can  be  ani¬ 
mated  to  display  time  varying  data. 
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Appendix  F 


The  following  material  is  reprinted  with  permission  of  Professor  Eugene  S.  Ferguson 
from  his  1992  book.  Engineering  and  the  Mind's  Eye.  In  the  book.  Professor  Ferguson  takes 
a  probing  look  at  the  process  of  engineering  design  and  argues  that,  despite  modem  tech¬ 
nical  advances,  good  engineering  is  still  as  much  a  matter  of  intuition  and  nonverbal 
thinking  as  of  equations  and  computation. 

Engineering  and  the  Mind's  Eye 

Eugene  S.  Ferguson 


Failures  and  Other  Surprises 
Engineering  design  is  usually  carried  on  in  an 
atmosphere  of  optimistic  enthusiasm,  tem¬ 
pered  by  the  recognition  that  every  mistake  or 
misjudgment  must  be  rooted  out  before  plans 
are  turned  over  to  the  shops  for  fabrication. 

Despite  all  the  care  exercised  by  individuals 
and  all  the  systems  that  have  been  used  to  en¬ 
sure  that  aU  the  choices  made  in  selecting 
parts  and  arranging  them  to  work  together 
will  be  correct,  the  evidence  of  faulty  judg¬ 
ment  shows  up  again  and  again  in  some  of 
the  most  expensive  and  (at  least  on  paper  or 
on  a  computer  screen)  most  carehilly  de¬ 
signed  and  tested  machines  of  the  twentieth 
century. 

Of  course  there  is  nothing  new  about  wrong 
choices  and  faulty  judgments  in  engineering 
design.  More  than  a  hundred  years  ago, 
George  Frost,  editor  of  Engineering  News,  tried 
to  track  down  the  reasons  for  failures  of 
bridges  and  buildings  in  order  that  civil  engi¬ 
neers  might  learn  from  the  mistakes  of  others. 
"We  could  easily,"  he  wrote,  "if  we  had  the 
facilities,  publish  the  most  interesting,  the 
most  instructive  and  the  most  valued  engi¬ 
neering  journal  in  the  world,  by  devoting  it  to 
only  one  particular  class  of  facts,  the  records 


of  failures.  .  . .  For  the  whole  science  of  engi¬ 
neering,  properly  so-called,  has  been  built  up 
from  such  records." 

A  Journal  of  Failures  such  as  that  envisioned  by 
Frost  was  never  published;  however.  Engi¬ 
neering  News  and  its  successors  have  pre¬ 
sented  many  valuable  reports  of  engineering 
failures.*^  One  of  those  reports — careful,  com¬ 
prehensive,  knowledgeable,  and  fair  to  all 
parties — was  published  in  Engineering  News 
just  a  week  after  a  cantilever  railway  bridge 
being  built  over  the  St.  Lawrence  River  at 
(Quebec  City  collapsed  on  August  29,  1907, 
killing  74  workmen.^®  (See  Figures  7.1  &  7.2} 

The  writer  of  the  report  spent  several  days  on 
and  about  the  wreckage,  piecing  together  the 
evidence  before  his  eyes  and  the  meager  testi¬ 
mony  of  those  who  lived  through  the  col¬ 
lapse.  His  conclusion,  later  confirmed  by  the 
Canadian  government's  year-long  official  in¬ 
quiry,  was  that  one  of  the  compression  mem¬ 
bers  in  the  bottom  chord  of  the  landward 
("anchor")  arm  of  the  cantilever  truss  buckled 
and  immediately  brought  the  rest  of  the  span 
down  on  top  of  it.  As  figures  7.3  and  7.4 
show,  the  bridge  collapsed  without  significant 
movement  to  one  side  or  the  other.  The  failed 
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Figure  7.1 .  Drawing  of  steel  cantilever  railroad  bridge  being  built  across  St  Lawrence  River 
near  Quebec  Qty  in  1907.  (Phoenix  Bridge  Company  Papers,  Hagley  Museum 
and  Library) 


Figure  7.2.  The  southern  end  of  the  (Quebec  City  bridge  a  few  days  before  its  collapse.  (Phoenix 
Bridge  Company  Papers.  I  am  indebted  to  Chris  Baer  for  locating  this  photograph.) 


Figure  7.3.  The  (Juebec  Gty  bridge  fell  straight  down  onto  itself,  leaving  an  amazingly  compact 
line  of  wreckage  (as  indicated  by  "Approx,  top  of  wreckage"  in  this  drawing). 
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Figure  7.4.  The  low  prohle  of  the  wreckage  of  the  Quebec  Qty  Bridge  is  evident  in  this  photo¬ 
graph.  The  pile  of  debris  on  the  bridge  pier  was  perhaps  10  feet  above  the  pier's  top 
surface.  (Phoenix  Bridge  Company  Papers,  Hagley  Museum  and  Library) 


member,  57  feet  long  and  4  V2  feet  deep,  was 
of  built-up  construction,  but  in  hindsight  the 
bracing  was  not  sufficient  to  prevent  the 
whole  member  from  buckling  under  length¬ 
wise  stress. 

"Long  and  careful  inspection  of  the  wreck¬ 
age,"  wrote  the  reporter,  "shows  that  the  ma¬ 
terial  was  of  excellent  quality;  that  the 
workmanship  was  remarkably  good."  But 
because  the  members  were  much  larger  than 
th(^  used  in  ordinary  bridges,  he  questioned 
the  judgment  that  led  to  the  design  of  the 
built-up  compression  members:  "We  step  up 
from  the  ordinary  columns  of  ordinary  con¬ 
struction,  tried  out  in  multiplied  practice,  to 
enormous,  heavy,  thick-plat^  pillars  of  steel. 


and  we  apply  the  same  rules.  Have  we  the 
corrfirmation  of  experiment  as  a  warranty? 
Except  in  the  light  of  theory,  these  structures 
are  virtually  unknown.  We  know  the  material 
that  goes  into  their  make-up,  but  we  do  not 
know  the  composite,  the  structure." 

Within  a  few  weeks  after  the  Quebec  City 
bridge  collapse.  Scientific  American  published 
a  "doctored"  figure  that  gave  visual  meaning 
to  the  stress  on  the  bridge's  failed  chords  by 
setting  up  one  of  the  chords  as  a  column  and 
perching  the  USS  Brooklyn,  a  9215-ton  cruiser, 
precariously  on  it  (figure  75).  In  a  series  of 
small  drawings  at  the  bottom  of  this  figure, 
the  cross  section  of  the  Quebec  chord  was 
compared  visually  to  the  much  heavier  com- 
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Figure  75.  Scientific  American's  lesson  on  buckling.  The  weight  of  the  cruiser  Brooklyn  was 

about  the  same  as  the  calculated  axial  load  on  the  chord  girder  that  failed  at  Quebec 
City.  The  perspective  drawing  of  the  girder  reveals  inadequate  bracing. 

(Scientific  American  97  (October  12, 1907)  pp.  257-258) 


pression  chord  members  of  the  Hell  Gate 
Bridge  (in  New  York)  and  a  cantilever  bridge 
over  the  Firth  of  Forth  (in  Scotland). 

The  Engineering  News  report  on  the  Quebec 
bridge  collapse  was  entitled  "The  Greatest 
Engineering  (Disaster,"  and  in  one  seiue  that 
characterization  still  holds  true.  No  other 
construction  accident  in  the  twentieth  century 
has  claimed  as  many  lives.  The  runner-up  is 


the  1978  collapse  of  a  "jack-up  formwork  sys¬ 
tem"  on  the  top  layer  of  a  168-foot  build-up 
concrete  cooling  tower  in  Saint  Mary's,  West 
Virginia.  All  51  of  the  workmen  on  the  tower 
fell  to  their  deaths. 

There  is  today  an  unfortunate  tendency  on 
the  part  of  many  analysts  to  assume  that  a 
failure  is  the  result  of  incomplete  analysis, 
and  that  the  newer  techniques  available  to  de- 
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Figure  7.6.  The  framing  system  of  the  Hartford  Coliseum.  Top:  Roof  purlin  framing.  Middle: 

Space  truss.  Bottom  left  Pyramidmoduleof  space  truss.  Bottom  right  Plan  view 
of  pyramid  modules.  (After  report  prepared  by  Lev  Zetlin  Associates.) 


27-year-old  radio  telescope,  3{X)  feet  in  diame-  permitted  today,"  and  that  a  "computerized 
ter,  in  Green  Bank,  West  Virginia,  implied  that  stress  analysis  would  identify  potential  fail- 
such  a  failure  could  not  occur  in  a  radio  tele-  ure  points  in  telescopes  built  today,  but  these 
scope  designed  today.  The  "cause"  of  the  col-  methods  were  not  available  when  the  instru- 
lapse  was  pinpointed  in  "a  single  highly  ment  was  built  in  1%2. One  wonders  what 
stressed  steel  plate"  (which  had  survived  for  smug  and  superior-by-hindsight  explanation 
more  than  25  years).  An  "independent  panel  wUl  be  given  for  the  collapse,  some  years 
appointed  by  the  National  Science  Founda-  hence,  of  a  structure  designed  today  wift  the 
tion"  declared  that  "parts  of  the  telescope  help  of  a  "computerized  stress  analysis." 
were  under  far  higher  stresses  than  would  be 
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Figure  71.  The  Hartford  Coliseum  after  its  roof  collapsed.  The  contorted  comers  of  the  space 
frame  are  visible  above  the  roof  level.  (AP/Wide  World  Photos) 


A  much  more  sensible  and  realistic  outlook 
on  design  failures  may  be  found  in  a  little 
book  entitled  To  Engineer  Is  Human:  The  Rde 
of  Failure  in  Successful  Design,  written  by 
Henry  Petroski,  a  professor  of  civil  engineer¬ 
ing  who  graduated  from  an  engineering 
school  in  the  early  1960s.  Toward  the  end  of 
his  book,  Petroski  has  a  chapter  called  "From 
Slide  Rule  to  Computer:  Forgetting  How  It 
Used  to  Be  Done."  Petroski  describes  the 
Keuffel  &  Esser  Log  Log  Duplex  Dedtrig 
slide  rule  that  he  purchased  when  he  entered 
engineering  school  in  1959  in  order  to  empha¬ 
size  that  the  limits  of  a  slide  rule's  accuracy — 
generally  three  significant  figures — are  no 
disadvantage  because  the  data  on  which  the 
calculations  depend  are  seldom  better  than 
approximations.  Petroski  is  one  of  too  few 


academic  engineers — he  teaches  at  Duke — 
who  fully  appredate  the  ambiguities  in  de¬ 
sign  and  analysis. 

Petroski  uses  the  1978  collapse  of  the  modem 
"space-frame"  roof  of  the  Hartford  Coliseum 
under  a  moderate  snow  load  as  an  example  of 
the  limitations  of  computerized  design.  The 
roof  failed  a  few  horns  after  a  baskeft>all  game 
attended  by  several  thousand  people,  and 
providentially  nobody  was  hurt  in  the  col¬ 
lapse.  Petroski  explains  the  complexity  of  a 
space  frame,  which  suggests  a  mammoth 
Tinker  Toy,  with  long  straight  steel  rods  ar¬ 
ranged  vertically,  horizontally,  and  diagonaUy. 
Figure  7.6  illustrates  the  roof's  framing  sys¬ 
tem  of  space  truss  and  purlins.  To  design  a 
space  frame  using  a  slide  mle  or  a  mechanical 
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calculator  was  a  laborious  process  wittr  too 
many  uncertainties  for  nearly  any  engineer,  so 
space  frames  were  seldom  built  before  com¬ 
puter  programs  were  available.  With  a  com¬ 
puter  model,  however,  analyses  can  be  made 
quickly.  The  computer's  apparent  precision, 
says  Petroski — six  or  more  significant  figures 
— can  give  engineers  "an  unwarranted  confi¬ 
dence  in  the  validity  of  the  resulting  num¬ 
bers." 

In  1979,  when  a  space  frame  to  support  the 

roof  of  the  Gerjild  R.  Ford  Museum  in  Grand 

Rapids,  Michigan,  was  under  construction. 

Ford  became  concerned  about  its  safety  in 

view  of  the  collapse  in  Hartford  and  one  in 
u  * 

Kansas  Qty.  Accordingly,  the  roof  of  the 
museum  was  tested  by  loading  it  with  200 
plastic-lined  wooden  boxes,  each  about  12 
feet  square  and  filled  with  water  to  a  level  of 
8  inches,  slightly  exceeding  the  design  load  of 
40  pounds  per  square  foot.  The  maximum 
deflection  was  about  11/2  inches,  which  ap¬ 
parently  satisfied  Ford  and  his  engineers.  The 
cost  of  the  test,  about  $40,000,  provoked  the 
project  architect  to  comment  that  "it's  un¬ 
usual  to  load  test  a  structure  of  this  size  be¬ 
cause  it  is  obviously  quite  an  exp>ense."  The 
cost  of  the  building  was  reported  as  $3  mil¬ 
lion;  the  "quite  an  expense"  amounted  to  less 
than  1.5  percent  of  the  total  cost,  a  small 
amount  in  view  of  the  justifiable  concerns 
about  the  safety  of  the  structure.  ^ 

Who  makes  the  computer  model  of  a  pro¬ 
posed  structure  is  of  more  than  passing  inter¬ 
est.  If  the  model  is  incorporated  in  a 
commercially  available  analytical  program,  a 
designer  using  such  a  program  will  have  no 
easy  way  of  discovering  all  the  assumptions 
made  by  the  programmer.  Consequently,  the 
designer  must  either  accept  on  faith  the  pro¬ 
gram's  results  or  check  the  results — experi¬ 
mentally,  graphically,  and  numerically — in 
sufficient  depfii  to  satisfy  himself  that  the  pro¬ 
grammer  did  not  make  dangerous  assumj?- 


tions  or  omit  critical  factors  and  that  the  pro¬ 
gram  reflects  fully  the  subtleties  of  the  de¬ 
signer's  own  uruque  problena. 

To  underline  the  hazards  of  using  a  program 
written  by  somebody  else,  Petroski  quotes  a 
Canadian  structural  engineer  on  the  use  of 
commercial  software: 

Because  structural  analysis  and  detailing 
programs  are  complex,  tlie  profession  as  a 
whole  will  use  programs  written  by  a  few. 
Those  few  will  come  from  the  ranks  of  struc¬ 
tural  “analysts".  .  .  and  not  from  the  struc¬ 
tural  “designers."  Generally  speaking,  their 
design  and  construction-site  experience  and 
background  will  tend  to  be  limited.  It  is  diffi¬ 
cult  to  envision  a  mechanism  for  ensuring 
that  the  products  of  such  a  person  will  dis¬ 
play  the  experience  and  intuition  of  a  compe¬ 
tent  designer.  .  .  .More  than  ever  before,  the 
challenge  to  the  profession  and  to  educators 
is  to  develop  designers  who  will  be  able  to 
stand  up  to  and  reject  or  modify  the  resuds 
of  a  computer-aided  analysis  and  design. 

The  engineers  who  can  "stand  up  to"  a  com¬ 
puter  will  be  those  who  understand  that  soft¬ 
ware  incorporates  many  assumptions  that 
cannot  be  easily  detected  by  its  users  but 
which  affect  the  validity  of  the  results.  There 
are  a  thousand  points  of  doubt  in  every  com¬ 
plex  computer  program.  Successful  com¬ 
puter-aided  design  requires  vigilance  and  the 
same  visual  knowledge  and  intuitive  sense  of 
fitness  that  successful  designers  have  always 
depended  upon  when  making  critical  design 
decisions. 

Engineers  need  to  be  continually  reminded 
that  nearly  all  engineering  failures  result  from 
faulty  judgments  rather  than  faulty  calcula¬ 
tions.  For  example,  in  the  1979  accident  in  the 
nuclear  power  plant  at  Three  Mile  Island,  the 
level  of  the  coolant  in  the  reactor  vessel  w'as 
low  because  an  automatic  relief  valve  re- 
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mained  open,  while  for  more  than  two  hours 
after  the  accident  began  an  indicator  on  the 
control  panel  said  it  was  shut.  The  relief 
valve  was  opened  by  energizing  a  solenoid;  it 
was  closed  by  a  simple  spring.  The  designer 
who  specified  the  controls  and  indicators  on 
the  control  panel  assumed  that  there  would 
never  be  a  problem  of  the  valve's  closing 
properly,  so  he  chose  to  show  on  the  panel  not 
the  valve  position  but  merely  whettier  the  so¬ 
lenoid  was  "on"  or  "off."  When  the  solenoid 
was  "off,"  he  assumed,  the  valve  would  be 
closed.  The  operators  of  the  plant  assumed, 
quite  reasonable,  that  the  indicator  told  them 
directly,  not  by  inference,  whettrer  the  valve 
was  open  or  closed.  The  choice  made  in 
this  case  may  have  seemed  so  simple  and  sen¬ 
sible  as  to  be  overlooked  in  whatever  check¬ 
ing  the  design  underwent.  It  might  have  been 
reexamined  had  the  checker  had  experience 
with  sticky  relief  valves  or  compreherrsion  of 
the  life-and-death  importance  of  giving  a  nu¬ 
clear  power  plant's  operators  direct  and  accu¬ 
rate  information.  This  was  not  a  failure  of 
calculation  but  a  failure  of  juc%ment. 

A  Cycle  of  Blunders 

A  cluster  of  newspaper  articles  in  the  first  half 
of  1990  (a  similar  crop  may  be  harvested  in 
any  half-year)  has  fattened  my  "failure"  file 
folder  and  has  led  me  to  expect  only  more  of 
the  same  under  the  accepted  regimen  of  ab¬ 
stract,  high-tech  design.  The  magnitude  of 
the  errors  of  judgment  in  some  of  the  re¬ 
ported  failures  (and  the  numerous  failures  in 
the  Elepartment  of  Defense  projects  that  are 
protected  from  full  public  disdosure)  sug¬ 
gests  that  engineers  of  the  new  breed  have 
climbed  to  the  tops  of  many  bureaucratic  lad¬ 
ders  and  are  now  making  decisions  that 
should  be  made  by  people  with  mote  com¬ 
mon  sense  and  experience. 

The  first  oil  spill  of  the  year  occurred  in  New 
York  waters  when  a  transfer  line  from  the 
Exxon  Bayway  refinery  to  a  tanker-loading 


dock  on  Staten  Island  spilled  500,000  gallons 
into  Arthur  Kill  on  the  first  day  of  January. 
Half  a  million  gallons  of  oil  will  fill  four  stor¬ 
age  tanks  30  feet  in  diameter  and  about  25 
feet  tall  -  the  mid-size  tanks  one  sees  in  a  re¬ 
finery  tardc  farm.  A  few  feet  on  a  side  seam 
had  split  in  a  section  of  pipe,  an  and  automat¬ 
ic  alarm  valve,  intended  to  shut  off  the  flow, 
detected  the  leak  but  had  been  wedged  by  the 
operators  so  it  would  not  shut  off.  The  valve 
had  been  wedged  open  for  12  years  because 
the  shut-down  alarm  was  "too  sensitive"  and 
kept  interrupting  flow  in  the  pipeline.  In  all 
those  years,  according  to  Exxon,  the  pipe  had 
never  leaked. 

On  April  12,  half  a  page  of  the  New  York  Times 
was  devoted  to  explaining  how  "smart"  cars 
and  highways  would,  in  some  indefinite  fu¬ 
ture,  "help  unsnarl  gridlock."  A  "major  pro¬ 
gram  of  computerization  and  automation  that 
would  fundamentally  alter  the  designs  of  ve¬ 
hicles  and  highways"  is  being  actively  pro¬ 
moted  by  the  U.S.  Department  of 
Transportation.  Research  is  under  way  on 
"computerized  dashboard  maps"  to  tell  the 
driver  where  he  is,  "roadside  sensors  and  sig¬ 
nals  to  manage  the  flow  of  traffic,"  and  "so¬ 
phisticated  steering  and  spreed  controls  that 
might  someday  even  let  cars  drive  themselves 
on  specially  instrumented  highways."^ 
Among  the  "sensors  and  signals"  is  a  system 
intended  to  warn  drivers  of  heavy  traffic 
ahead  and  to  inform  them  of  possible  alterna¬ 
tive  routes.  Instruments  will  measure  traffic 
flow  and  feed  their  information  to  a  "control 
center."  The  control  center  will  relay  the  in¬ 
formation  to  a  satellite;  the  satellite  will  send 
the  information  to  cars  "in  the  area."  The  in¬ 
formation  will  then  be  displayed  on  a  "dash¬ 
board  morutor,"  which  the  driver  can 
presumably  study  at  leisure  (f>erhap)s  viewing 
advertisements  when  not  checking  traffic  con¬ 
ditions).  Only  Rube  Goldberg  could  have  de¬ 
vised  a  mote  absurd  (or  expensive)  scheme  to 
do  things  in  elaborate  ways.  A  trial  of  the  sys- 
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tern  will  be  conducted  in  Orlando,  a  most  ap¬ 
propriate  location  for  fantasy  technology.  The 
Times  article  made  no  mention  of  the  $500 
million  already  spent  by  the  Department  of 
Defense  on  a  "smart  truck"  about  a  year  ear¬ 
lier.  That  five-year  program  to  develop  an 
"autonomous  truck"  that  could  drive  itself 
and  find  its  way  on  and  off  highways  had 
been  phased  out  because  of  abysmally  defi¬ 
cient  performance.  When  the  truck  was  being 
taught  to  guide  itself  on  a  highway,  it  could 
operate  only  at  noon,  with  the  sun  directly 
overhead,  because  it  was  confused  by  shad¬ 
ows.  Eventually,  it  was  able  to  travel  at  12 
miles  per  hour  on  straight,  paved  test  track, 
and  "to  negotiate  curves  and  to  travel  at  any 
time  of  day  and  even  at  night  using  laser 
range  finders."  When  it  tried  to  make  its  way 
across  open  desert,  "avoiding  bushes  and 
ditches  along  the  way,"  its  best  performance 
was  to  guide  itself  about  600  yards  at  2  miles 
per  hour. 

On  May  7,  the  Wall  Street  Journal  gave  careful 
account  of  the  expensive  problems  that  poor 
design  judgment  and  unreasonable  produc¬ 
tion  deadlines  caused  when  General  Electric 
introduced  a  new  and  insufficiently  tested 
compressor  in  its  domestic  refrigerators  in 
1986.  The  new  refrigerators  featured  rotary 
compressors  rather  than  the  reciprocating 
compressors  that  had  been  employed  since 
the  1920s.” 

Rotary  compressors,  already  used  in  air  con¬ 
ditioners,  were  attractive  to  GE  managers  be¬ 
cause  they  were  expected  to  be  much  cheaper 
to  build.  Many  engineers  learned  in  school  a 
bit  of  folklore  about  the  invariable  superiority 
of  rotating  machinery  over  reciprocating  ma¬ 
chinery.  Rotating  gas  compressors,  however, 
require  substantially  more  power  than  recip¬ 
rocating  compressors,  and  their  high  rotative 
speeds  make  them  difficult  to  cool  and  lubri¬ 
cate. 


The  designers  of  the  new  compressors  ig¬ 
nored  the  sigrrificant  difference  in  perform¬ 
ance  requirements  between  air  conditioners 
and  refrigerators.  In  air  conditioners,  a  con¬ 
venient  stream  of  air  kept  the  body  of  the 
compressor,  and  thus  the  lubricating  oil 
sealed  inside,  cool.  Refrigerators  lacked  an 
equivalent  air  stream,  and  none  was  provided 
to  cool  the  new  compressors. 

An  experienced  consultant  told  GE  to  buy 
compressors  abroad  or  to  learn  how  to  make 
better  compressors  than  those  they  planned  to 
use.  Although  the  designers  had  no  experi¬ 
ence  with  rotary  compressors,  they  rejected 
the  advice  and  proceeded  to  develop  a  design 
that  required  tolerances  smaller  than  any 
found  in  mass-produced  machines  of  any 
kind.  According  to  one  of  his  former  associ¬ 
ates,  the  chief  design  engineer  "figured  you 
didn't  need  compressor-design  experience  to 
design  a  new  compressor." 

The  first  of  the  new  compressors  were  to  be 
tested  for  the  assumed  lifetime  of  a  refrigera¬ 
tor;  however,  the  tests  were  cut  short  long  be¬ 
fore  a  "lifetime"  had  elapsed,  and  the 
misgivings  voiced  by  the  experienced  techni¬ 
cian  who  ran  the  tests  were  disregarded.  This 
senior  technician — who  had  worked  in  the 
testing  lab  for  30  years — reported  that,  al¬ 
though  compressors  did  not  actually  fail  in 
the  truncated  testing  program,  "they  didn't 
look  right,  either."  Discoloration  from  high 
temperatures,  bearing  surfaces  that  looked 
worn,  and  a  black  oily  crust  on  some  parts 
pointed  to  eventual  trouble  witti  overheating, 
wear,  and  a  breakdown  of  the  sealed-in  lubri¬ 
cating  oil.  The  experience-based  assessment 
was  discounted  because  it  came  from  a  mere 
technician,  a  dirty-hands  worker  of  much 
lower  status  than  a  scientific  engineer. 

The  new  refrigerators  sold  well,  no  doubt 
lai^ely  because  they  had  other  new  features 
suA  as  a  "refreshment  center"  in  the  door. 
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Troubles  in  the  field  did  not  begin  until  al¬ 
most  a  year  after  their  introduction.  When 
the  dimensions  of  the  design  debacle  began  to 
be  clear,  the  company  decided  to  forestall  a 
likely  customer  revolt  against  all  GE  products 
by  voltmtarily  replacing  more  than  a  million 
rotary  compressors  with  reciprocating  com¬ 
pressors  at  a  cost  of  about  $450  million. 

In  May  of  1990,  NASA  returned  to  the  front 
pages  with  two  blimders  less  chilling  than  the 
Challenger  explosion  but  likely  to  waste  hun¬ 
dreds  of  millions  of  dollars. 

The  Hubble  space  telescope,  laundied  on 
April  24,  had  been  confidently  advertised  as 
the  answer  to  the  problem  of  the  atmos¬ 
phere's  interference  with  extremely  faint  light 
waves  from  far-distant  heavenly  bodies.  The 
space  telescope  was  expected  to  increase  the 
diameter  of  the  known  universe  by  a  factor  of 
7.  The  first  pictures  were  to  be  transmitted 
to  earth  a  week  after  the  launch.  Seven  weeks 
later,  several  unexpected  happenings  had 
postponed  the  first  transmission  to  the  end  of 
the  year,  about  8  months  behind  schedule. 
Most  significantly,  an  error  had  been  made  in 
grinding  the  large  mirror,  and  it  was  impossi¬ 
ble  to  bring  any  heavenly  bodies  into  sharp 
focus.  Computer  experts  proposed  programs 
that  would  "enhance"  the  distorted  images, 
but  one  may  reasonably  doubt  the  veracity  of 
such  enhancement. 

The  first  smaller-scale  mishap  involving  the 
Hubble  occurred  when  the  satellite  carrying 
the  telescope  was  launched  from  the  shuttle 
vehicle.  An  electrical  cable,  coimecting  an  ad¬ 
justable  antenna  dish  to  the  television  trans¬ 
mitter,  was  kinked  as  it  exited  the  shuttle, 
causing  a  sigruficant  reduction  in  the  amount 
of  anterma  adjustment.  Transtrussion  to  earth 
was  interrupted  by  dre  inability  of  the  an¬ 
terma  to  be  continuously  pointed  at  the  re¬ 
ceiving  station. 


A  few  days  later,  newspaper  readers  learned 
that  the  telescope  could  not  be  pointed  accu¬ 
rately  at  the  stars  and  planets.  The  control¬ 
ling  computer  program  had  been  based  on 
"an  outdiated  star  chart,"  and  therefore  the 
telescope  suffered  a  pointing  error  of  about 
half  a  degree.  Furthermore,  the  telescope  de¬ 
veloped  a  tendency  to  drift  to  pick  up  other 
nearby  stars  just  slightiiy  brighter  or  ^mmer 
than  those  it  was  intended  to  hold  in  focus. 

Finally,  the  severe  vibration  of  the  entire  tele¬ 
scope  satellite  raised  questions  about  its  abil¬ 
ity  to  obtain  any  information  not  available  to 
ordinary  telescopes  located  on  the  ground. 
An  unanticipated  (i.e.,  unthought  of  in  the  de¬ 
sign)  cycle  of  expansion  and  contraction  of  so¬ 
lar  panel  supports,  as  the  spacecraft  moved 
into  and  out  of  the  earth's  shadow,  caused  the 
panels  to  sway  "like  the  slowly  flapping 
wings  of  a  great  bird."  The  computer  pro¬ 
gram  for  stabilizing  the  spacecraft,  confused 
by  the  unexpected  vibrations,  called  for  stabi¬ 
lizing  actions  that  exacerbated  the  vibration.^® 

Further  deficiencies  have  turned  up  in  Hub¬ 
ble's  second  year  in  orbit  Two  gyroscopes  (of 
six)  have  failed  and  two  others  exhibit  signs 
of  incipient  failure.  The  Goddard  high-reso¬ 
lution  spectrograph  may  have  to  be  shut 
down  because  of  intermittent  loss  of  connec¬ 
tion  with  its  data  computer.  The  flapping  so¬ 
lar  panels  are  attached  to  booms  which  have 
developed  a  jerky  motion  that  may  lead  to 
their  collapse  and  a  catastrophic  power  loss. 
Although  NASA  hopes  to  send  repair  mis¬ 
sions  to  Hubble  in  1W3,  on  wonders  whettier 
the  repair  missions  will  be  able  to  keep  ahead 
of  tire  failures  of  one  component  after  an¬ 
other.^  These  blimders  resulted  not  from 
mistaken  calculations  but  from  the  inability  to 
visualize  realistic  conditions.  They  suggest 
that  altiiough  a  great  deal  of  "hard  thinking" 
may  have  been  done  to  accomplish  the  stated 
missions  of  Hubble,  the  ability  to  imagine  the 
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mundane  things  that  can  go  wrong  remains 
sadly  deficient  at  NASA. 

While  the  Hubble  telescope,  a  caricature  of 
competent  design,  limped  through  the  sky, 
the  proposed  space  station  Freedom  entered 
the  news.  A  review  of  the  plans  for  the  space 
station,  to  be  assembled  in  space  over  a  pe¬ 
riod  of  several  years  starting  in  1995,  revealed 
that  the  station  might  not  be  practicable  be¬ 
cause  of  excessive  maintenance  requirements 
outside  the  crew's  living  and  working  spaces. 
Astronauts  would  have  to  spend  2200  hours 
each  year  in  space  suits,  outside  the  station, 
repairing  and  replacing  electronic  gear,  light 
bulbs,  solar  panels,  batteries,  and  thermal 
blankets.  The  original  estimate  of  mainte¬ 
nance  time  was  130  hours  per  year.  (In  30 
years  of  NASA  space  flights,  astronauts  have 
spent  a  total  of  400  hours  in  "space  walks.") 
An  earnest  former  astronaut,  testifying  before 
a  Congressional  subcommittee,  said  that  "the 
final  assessment  [of  maintenance  work]  will 
be  higher  than  I  like,"  but  concluded  that  the 
problem  is  not  a  "show-stopper."  John  E. 
Pike  of  the  Federation  of  American  Scientists 
agreed  with  the  astronaut  that  the  need  for  so 
much  maintenance  is  "politically  .  .  .  not  a 
death  blow."  "The  station  is  too  big  to  can¬ 
cel,"  said  Pike.  "They'll  muddle  through. 
There's  no  other  choice."  ^  Unfortunately, 
that  is  probably  an  accurate  assessment  of  the 
situation,  as  well  as  being  a  sad  commentary 
on  the  nature  of  a  bureaucratic  organization 
endowed  with  unlimited  money  and  ex¬ 
tremely  limited  common  sense. 

Top-down  Design 

Richard  Feynman,  the  maverick  physicist 
who  served  on  the  official  panel  reviewing 
the  Challenger  explosion,  not^  the  inevitabil¬ 
ity  of  more  failures  and  embarrassing  sur¬ 
prises  if  NASA  did  not  change  radically  the 
way  its  big  projects  were  designed.  He  called 
the  procedure  being  used  "top-down  design" 
and  contrasted  it  with  sensible  "bottom-up" 


design  that  has  been  normal  engineering 
practice  for  centuries. 

In  bottom-up  design,  the  components  of  a 
system  are  designed,  tested,  and  if  necessary 
modified  before  the  design  of  the  entire  sys¬ 
tem  has  been  set  in  concrete.  In  the  top-down 
mode  (invented  by  the  military),  the  whole 
system  is  designed  at  once,  but  without  re¬ 
solving  the  many  questions  and  conflicts  that 
are  normally  ironed  out  in  a  bottom-up  de¬ 
sign.  The  whole  system  is  them  built  before 
there  is  time  for  testing  of  comjxments.  The 
deficient  and  incompatible  components  must 
then  be  located  (often  a  difficult  problem  in  it- 
selO,  redesigned,  and  rebuilt — an  expensive 
and  uncertain  procedure. 

Furthermore,  as  Feynman  pointed  out,  the 
political  problems  faced  by  NASA  encourage 
if  not  force  it  to  "exaggerate"  when  explaining 
its  reasons  for  needing  large  sums  of  money. 
It  was  "apparently  necessary  [in  the  case  of  the 
shuttle]  to  exaggerate:  to  exaggerate  how 
economical  the  shuttle  would  be,  to  exagger¬ 
ate  how  often  it  would  fly,  to  exaggerate  how 
safe  it  would  be,  to  exaggerate  the  big  scien¬ 
tific  facts  that  would  be  discovered.  'The 
shuttle  can  make  so-and-so  many  flights  and 
it'll  cost  such-and-such;  we  went  to  the  moon, 
so  we  can  do  it!"'  ^ 

Until  the  foolishness  of  top-down  designs  has 
been  dropped  in  a  fit  of  common  sense,  the 
harrowing  succession  of  flawed  designs  will 
continue  to  appear  in  high-tech,  high-cost 
public  projects. 

The  Unmet  Need  for  Reflection 
Although  the  need  for  the  space  station — 
whose  estimated  cost  has  risen  from  $8  billion 
in  1984  to  more  than  $1(X)  billion  when  oper¬ 
ating  costs  are  included  (or  $30-50  billion 
when  operating  costs  are  not  included — is 
purely  political,  some  better  assurance  of  a 
workable  design  might  be  gained  by  taking 
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Figure  7£.  The  Tacoma  Nanx)ws  bridge  on  November  7, 1940,  just  before  tfie  destruction  of  its 
suspended  dedc  by  a  quartering  wind  with  a  velocity  of  42  miles  per  hour.  (Jacob 
Feld  summed  up  the  visual  message  when  he  wrote  in  Constructim  Failures  (New 
York,  1968)  that  "the  photographic  record  of  the  torsional  oscillations  made  by 
Profesor  F.  B.  Farquhaison  did  more  to  prove  the  necessity  for  aerodynamic 
investigation  of  structures  than  all  the  theoretical  reports.") 


seriously  a  prescription  for  the  design  of  pio¬ 
neering  projects  made  in  the  mid  1960s  by  a 
prominent  British  structural  engineer.  Sir 
Alfred  Pugsley  saw  the  need  in  such  projects 
to  give  the  chief  engineer  a  "sparring  part¬ 
ner,"  a  senior  engineer  who  has  privy  to  es¬ 
sentially  all  the  mformation  available  to  the 
chief  engineer  and  whose  status  was  such 
that  the  chief  would  not  ignore  his  conunents 
or  recommendations.  This  sparring  partner 
would  be  given  ample  time  to  follow  the  de¬ 


sign  work  and  to  study  and  think  about  the 
implications  of  details  as  well  as  the  "big"  de¬ 
cisions  made  by  the  chief  engineer. 

The  hazards  of  permitting  a  chief  engineer  to 
determine  all  aspects  of  a  complex  project, 
without  critical  review,  are  less  insidious  and 
far-reaching  than  another  hazard  that  Pugsley 
also  warned  against:  the  frequent  adoption 
of  a  faulty  doctrine  by  a  whole  profession. 
Pugsley's  example  of  misplaced  enthusiasm 
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Figure  73  The  deck  of  the  Tacoma  Narrows  bridge  disintegrating. 

for  a  new  doctrine  was  the  collapse  of  the  Ta-  ics,  he  thought,  the  collapse  might  have  been 
coma  Narrows  suspension  bridge  in  1940,  the  averted.  ^  It  is  fairly  certain,  however,  that  if 
"major  lesson"  of  which  was  "the  unwisdom  the  relevance  of  aerodynamics  to  the  design 
of  allowing  a  particular  profession  to  become  had  been  suggested  by  a  person  outside  the 
too  inward  looking  and  so  screened  from  rele-  network  of  "leading  structural  engineers,"  the 
vant  knowledge  growing  up  in  other  fields  advice  would  have  been  considered  an  attack 
around  it."  Had  die  designers  of  the  Tacoma  on  the  profession  of  civil  engineering.  The  ex- 
Narrows  bridge  known  more  of  aerodynam-  perience  of  two  engineers  who  published  his- 
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torical  articles  on  the  collapse  of  the  bridge 
supports  my  surmise.  The  professional  reac¬ 
tion  to  an  article  in  Engineering  News-Record 
by  Dean  James  Kip  French  of  the  Columbia 
University  engineering  school  prompted  him 
to  virtually  retract  its  contents.  ^  David  Bill- 
ington,  an  unorthodox  professor  of  civil  engi¬ 
neering  at  Princeton,  was  excoriated  by 
several  prominent  bridge  engineers  when  his 
pap>er  on  events  leading  to  the  collapse  was 
published  in  a  journal  of  the  American  Soci¬ 
ety  of  Civil  Engineers.  ** 

Billington,  in  a  historical  study  of  suspension 
bridges,  argues  convincingly  that  a  design  de¬ 
cision  made  in  the  1920s  by  O.  H.  Ammann, 
designer  of  the  George  Washington  Bridge  in 
New  York,  "led  directly  to  the  failure  of  the 
Tacoma  Narrows  Bridge."  Ammaim  decided 
that  the  deck  of  his  bridge  could  be  built 
without  vertical  stiffening  and  omitted  the 
stiffening  trusses  that  John  Roebling  and 
other  suspension-bridge  engineers  had  felt 
were  necessary  to  keep  winds  from  causing 
undulation  of  the  bridge  deck.  Ammaim's 
reasoning  appealed  to  many  in  the  civil  engi¬ 
neering  profession,  and  several  long,  slender, 
and  disturbingly  flexible  suspension  bridges 
were  built  in  the  1930s  (including  the  Golden 
Gate  Bridge,  which  was  stiffened  after  a 
harrowing  experience  with  crosswinds  in 
1951).“® 

After  the  Tacoma  Narrows  bridge  fell,  struc¬ 
tural  engineers  found  that  a  sense  of  history 
might  have  tempered  their  enthusiastic  accep¬ 
tance  of  Ammann's  design  precept.  They 
learned,  as  Billington  points  out,  that  publish¬ 
ed  records  of  suspension  bridges  in  Europe 
and  America  "described  nineteenth-century 
failures  were  amazingly  similar  to  what  they 
saw  in  the  motion  pictures  of  the  Tacoma  col¬ 
lapse." 

Billington's  article  was  characteristically 
greeted  by  engineers  as  an  "attack  upon  the 


leading  figures  of  the  period  and  especially 
upon  O.  H.  Ammann."  Rebuttal  was  neces¬ 
sary,  according  to  Billington's  many  critics,  in 
order  to  "remove  the  undeserved  blame"  lev¬ 
eled  at  several  bridge  designers  and  to  "pre¬ 
serve  their  proper  position  in  the  history  of 
engineering." 

The  need  to  justify  the  way  engineers  do 
things  is  unfortunately  present  even  when  ill- 
considered  systems  lead  operators  to  make  fa¬ 
tally  wrong  judgments. 

The  missile  cruiser  USS  Vincennes  was 
equipped  with  a  billion-dollar  "state-of-the- 
art"  air  defense  system  called  Aegis.  On  July 
3, 1988,  the  ship  shot  down  an  Iranian  civilian 
airliner  and  thus  killed  3(X)  people.  The 
Aegis  system  had  received  IFF  (Identification 
of  Friend  or  Foe)  signals  for  both  military  and 
civilian  planes,  yet  the  ship's  radar  indicated 
only  one  plane,  and  the  decision  was  made  to 
destroy  it.  (No  radar  or  other  existing  equip¬ 
ment  will  identify  a  plane  by  its  physical 
shape  and  size  alone.)  Later  the  Navy  de¬ 
cide  that  an  enlisted  man  had  misinter¬ 
preted  the  signals  on  his  visual  display  and 
that  therefore  the  captain  was  not  at  fault  for 
ordering  the  destruction  of  the  civilian  air¬ 
plane. 

As  with  most  "operator  errors"  that  have  led 
to  major  disasters,  the  operators  aboard  the 
USS  Vincennes  had  been  deluged  with  more 
information  than  they  could  assimilate  in  the 
few  seconds  before  a  crucial  decision  had  to 
be  made.  It  is  a  gross  insult  to  the  operators 
who  have  to  deal  with  such  monstrous  sys¬ 
tem-!,  as  the  Navy  did,  that  the  Aegis  system 
worked  perfectly  and  that  the  tragedy  was 
due  to  "operator  error." 

The  designers  of  Aegis,  which  is  the  proto¬ 
type  system  for  SDl,  grossly  underestimated 
the  demands  that  their  designs  would  place 
on  the  operators — who  often  lack  knowledge 
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of  the  idiosyncrasies  and  limitations  built  into 
the  system.  Disastrous  errors  and  judgments 
are  inevitable  so  long  as  operator  error  rather 
than  designer  error  is  routinely  considered  as 
the  cause  of  disasters.  Hubris  and  an  absence 
of  common  sense  in  the  design  process  set  the 
conditions  that  produce  the  confusingly  over¬ 
complicated  tasks  that  the  ecjuipment  de¬ 
mands  of  operators.  Human  abilities  and 
limitations  need  to  be  designed  into  systems, 
not  designed  out. 

If  we  are  to  avoid  calamitous  errors  as  well  as 
those  that  are  merely  irritating  or  expensive,  it 
is  necessary  that  engineers  understand  that 
such  errors  are  not  errors  of  mathematics  or 
calculation  but  errors  of  engineering  judg¬ 
ment — judgment  that  is  not  reducible  to  engi¬ 
neering  science  or  to  mathematics. 


Here,  indeed,  is  the  crux  of  all  arguments 
about  the  nature  of  the  education  that  an  en¬ 
gineer  requires.  Necessary  as  the  analytical 
t(X)ls  of  science  and  mathematics  most  cer¬ 
tainly  are,  more  important  is  the  development 
in  student  and  neophyte  engineers  of  sound 
judgment  and  an  intuitive  sense  of  fitness  and 
adequacy. 

No  matter  how  vigorously  a  "science"  of  de¬ 
sign  may  be  pushed,  the  successful  design  of 
real  things  in  a  contingent  world  will  always 
be  based  more  on  art  than  on  science.  Un- 
quantifiable  judgments  and  choices  are  the 
elements  that  determine  the  way  a  design 
comes  together.  Engineering  design  is  simply 
that  kind  of  process.  It  always  has  been;  it  al¬ 
ways  will  be. 
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